2025-11-01T04:39:47.793239Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7567612064154264091:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:39:47.793356Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-01T04:39:47.802001Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7567612062023906578:2087];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:39:47.802378Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-01T04:39:47.803448Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-01T04:39:47.803991Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/ni8w/002121/r3tmp/tmpaZm1GI/pdisk_1.dat
2025-11-01T04:39:47.808739Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-01T04:39:47.809734Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-11-01T04:39:47.874449Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-01T04:39:47.895223Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-01T04:39:47.895310Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-01T04:39:47.898646Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 15210, node 4
2025-11-01T04:39:47.913899Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-01T04:39:47.913974Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-01T04:39:47.920517Z node 4 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 5 Cookie 5
2025-11-01T04:39:47.921077Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-01T04:39:47.933579Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/ni8w/002121/r3tmp/yandexl7LgLa.tmp
2025-11-01T04:39:47.933603Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/ni8w/002121/r3tmp/yandexl7LgLa.tmp
2025-11-01T04:39:47.935007Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/ni8w/002121/r3tmp/yandexl7LgLa.tmp
2025-11-01T04:39:47.935193Z node 4 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-01T04:39:47.966738Z INFO: TTestServer started on Port 29358 GrpcPort 15210
2025-11-01T04:39:48.015294Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-01T04:39:48.020470Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TClient is connected to server localhost:29358
PQClient connected to localhost:15210
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-01T04:39:48.145839Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-01T04:39:48.175875Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-11-01T04:39:48.799349Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-01T04:39:48.805978Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-01T04:39:50.286125Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7567612074908808842:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:39:50.286215Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:39:50.286217Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7567612074908808850:2305], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:39:50.286485Z node 5 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [5:7567612074908808856:2306], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:39:50.286563Z node 5 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-01T04:39:50.291365Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-01T04:39:50.306550Z node 5 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [5:7567612074908808857:2307], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-11-01T04:39:50.392772Z node 5 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [5:7567612074908808885:2183] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges)" severity: 1 }
2025-11-01T04:39:50.417393Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [5:7567612074908808899:2311], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-01T04:39:50.417583Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=5&id=MmYxZjVhN2MtYjk3MDhhM2UtM2QxZTE3MDAtZGU2YTgzZjM=, ActorId: [5:7567612074908808840:2301], ActorState: ExecuteState, TraceId: 01k8yvdvrc0p2azsgycnp01247, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-01T04:39:50.417927Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-01T04:39:50.462303Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [4:7567612077039167087:2333], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-01T04:39:50.464178Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2500: SessionId: ydb://session/3?node_id=4&id=MjI3NzI0NTEtY2M5MzA1MTQtZjlmNzMzNjYtMjcxMTc4MTA=, ActorId: [4:7567612077039167059:2326], ActorState: ExecuteState, TraceId: 01k8yvdvx9csqapb8y8kxtydk6, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-11-01T04:39:50.464523Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-01T04:39:50.474266Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-01T04:39:50.525259Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-01T04:39:50.619628Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-01T04:39:50.789798Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720665. Ctx: { TraceId: 01k8yvdw5198wt2ym73xyw0a1b, Database: , SessionId: ydb://session/3?node_id=4&id=MzRiMDNlYzgtYmQwZDE0N2EtZjI5NGEyMjgtNjQ3NzhlNTI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [4:7567612077039167526:3071] 
2025-11-01T04:39:52.793425Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7567612064154264091:2080];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:39:52.793489Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-01T04:39:52.801101Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7567612062023906578:2087];send_to=[0:7307199536658146131:7762515];
2025-11-01T04:39:52.801172Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:15210
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-01T04:39:56.011819Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15210
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720670
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-01T04:39:56.030195Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037893][] pipe [4:7567612102808971687:3292] connected; active server actors: 1
2025-11-01T04:39:56.030747Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-01T04:39:56.031212Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-01T04:39:56.031528Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-01T04:39:56.032604Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-01T04:39:56.033602Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-01T04:39:56.033784Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-01T04:39:56.033818Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T04:39:56.033853Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-01T04:39:56.034108Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808971686:3291], now have 1 active actors on pipe
2025-11-01T04:39:56.034155Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808971712:2443], now have 1 active actors on pipe
2025-11-01T04:39:56.034358Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 5, Generation 1
2025-11-01T04:39:56.034694Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.037280Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.040913Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808971741:3335], now have 1 active actors on pipe
2025-11-01T04:39:56.041326Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.043915Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.044552Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-01T04:39:56.044586Z node 5 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-01T04:39:56.044805Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-01T04:39:56.045011Z node 5 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [5:7567612100678612919:2362]
2025-11-01T04:39:56.047052Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-01T04:39:56.047073Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-01T04:39:56.047090Z node 5 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [5:7567612100678612919:2362]
2025-11-01T04:39:56.047118Z node 5 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-01T04:39:56.047139Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T04:39:56.048054Z node 5 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-01T04:39:56.048099Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.048170Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.048185Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.048204Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-01T04:39:56.048214Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.048224Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.048233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-11-01T04:39:56.048262Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T04:39:56.048302Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-01T04:39:56.048713Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.048818Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.051460Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.051547Z node 5 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761971996085, TxId 281474976720670
2025-11-01T04:39:56.051567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.051578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.051675Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.051846Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.053871Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.053978Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T04:39:56.054064Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.054085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.054095Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.054104Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.054124Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.054384Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-01T04:39:56.054456Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T04:39:56.054638Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.057752Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.057835Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.059421Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.123504Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720671. Ctx: { TraceId: 01k8yve1c3c1y07nsbjwhpn840, Database: , SessionId: ydb://session/3?node_id=4&id=NDhlNjllNzEtYzFiNDg5ODUtN2U3Yzg5YzgtMzQ5MDUzOGE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1761971996085
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720670
    CreateStep: 1761971996085
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:15210
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-01T04:39:56.144001Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
PQ Client: create topic: rt3.dc1--topic12 with 1 partitions
CallPersQueueGRPC request to localhost:15210
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-01T04:39:56.146678Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:15210
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic12"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-11-01T04:39:56.148560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.148586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.148602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720672
  SchemeShardTabletId: 72057594046644480
  PathId: 14
}
ErrorCode: OK
AddTopic: rt3.dc1--topic12
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic12, dc = dc1
2025-11-01T04:39:56.166015Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1655: [72075186224037895][] pipe [4:7567612102808971866:3419] connected; active server actors: 1
2025-11-01T04:39:56.166202Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1519: [72075186224037895][rt3.dc1--topic12] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-01T04:39:56.166370Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037894] Handle TEvInterconnect::TEvNodeInfo
2025-11-01T04:39:56.166692Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037895][rt3.dc1--topic12] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037895
2025-11-01T04:39:56.167514Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037895][rt3.dc1--topic12] BALANCER INIT DONE for rt3.dc1--topic12: (0, 72075186224037894) 
2025-11-01T04:39:56.168044Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037894] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-01T04:39:56.168269Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037894] no config, start with empty partitions and default config
2025-11-01T04:39:56.168305Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T04:39:56.168338Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037894] doesn't have tx writes info
2025-11-01T04:39:56.168501Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808971896:2461], now have 1 active actors on pipe
2025-11-01T04:39:56.168533Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808971865:3418], now have 1 active actors on pipe
2025-11-01T04:39:56.168687Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037895][rt3.dc1--topic12] TEvClientConnected TabletId 72075186224037894, NodeId 5, Generation 1
2025-11-01T04:39:56.169193Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.171455Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.175591Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808971923:3465], now have 1 active actors on pipe
2025-11-01T04:39:56.176027Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.178654Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.179525Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitConfigStep
2025-11-01T04:39:56.179571Z node 5 :PERSQUEUE DEBUG: partition.cpp:1312: [72075186224037894][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-01T04:39:56.179784Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-01T04:39:56.179962Z node 5 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037894][Partition][0][StateInit] bootstrapping 0 [5:7567612100678613011:2368]
2025-11-01T04:39:56.182375Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitFieldsStep
2025-11-01T04:39:56.182407Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic12:0:Initializer] Initializing completed.
2025-11-01T04:39:56.182428Z node 5 :PERSQUEUE INFO: partition.cpp:707: [72075186224037894][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic12' partition 0 generation 1 [5:7567612100678613011:2368]
2025-11-01T04:39:56.182456Z node 5 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037894][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic12 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-01T04:39:56.182486Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037894][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T04:39:56.183570Z node 5 :PERSQUEUE DEBUG: partition.cpp:4273: [72075186224037894][Partition][0][StateIdle] Process pending events. Count 1
2025-11-01T04:39:56.183607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.183684Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.183700Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.183720Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Still pending for come commits
2025-11-01T04:39:56.183733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.183746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.183757Z node 5 :PERSQUEUE DEBUG: partition.cpp:2318: [72075186224037894][Partition][0][StateIdle] Still pending for come commits
2025-11-01T04:39:56.183786Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T04:39:56.183821Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:60: [72075186224037894][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-01T04:39:56.184245Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.184405Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.187459Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.187555Z node 5 :PERSQUEUE DEBUG: partition.cpp:1416: [72075186224037894][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761971996218, TxId 281474976720672
2025-11-01T04:39:56.187580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.187590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.187676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.187849Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.189448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.189550Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:83: [72075186224037894][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-01T04:39:56.189636Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.189658Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.189669Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.189676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.189696Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.189945Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037894] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic12" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic12" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-01T04:39:56.190015Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-01T04:39:56.190197Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.193683Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.193772Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-01T04:39:56.195419Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-01T04:39:56.248901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.248933Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.248942Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.249369Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720673. Ctx: { TraceId: 01k8yve1gba0bq8jj3zm55kr89, Database: , SessionId: ydb://session/3?node_id=4&id=M2JmMGZkYi04NTU1ZjFmZi0yMGU5ZTQ5MC1iYzMwNjIxYw==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic12
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 14
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1761971996218
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 14
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 14
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720672
    CreateStep: 1761971996218
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 14
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037894
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037895
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 13
    PathsLimit: 10000
    ShardsInside: 8
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic12"
 name rt3.dc1--topic12 version1
CallPersQueueGRPC request to localhost:15210
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-01T04:39:56.267562Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic12"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic12"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.269374Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.270167Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808971989:3505], now have 1 active actors on pipe
2025-11-01T04:39:56.270367Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.270393Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.270446Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|96bc6476-bbf3cd0b-a23762c3-1512f94d_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.270481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.270500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.270509Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.270539Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.270575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.270606Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.270721Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.271027Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808971989:3505] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|96bc6476-bbf3cd0b-a23762c3-1512f94d_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|96bc6476-bbf3cd0b-a23762c3-1512f94d_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
  }
  MessageNo: 0
}
2025-11-01T04:39:56.272408Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.273078Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808971992:3506], now have 1 active actors on pipe
2025-11-01T04:39:56.273303Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.273332Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.273594Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-01T04:39:56.273622Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.273650Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.273666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.273675Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.273762Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-01T04:39:56.284226Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.284253Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.284265Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.289493Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-01T04:39:56.289547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.289913Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1761971996289
2025-11-01T04:39:56.290041Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.290132Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-01T04:39:56.292478Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.292521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.292555Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.292592Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.292591Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-01T04:39:56.292619Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-01T04:39:56.292765Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T04:39:56.292785Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-01T04:39:56.292800Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.292811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.292819Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.292837Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.292863Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.292951Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-01T04:39:56.293103Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-01T04:39:56.293030Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.293119Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-01T04:39:56.293150Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:56.293168Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-01T04:39:56.293195Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:39:56.293229Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:39:56.293283Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-01T04:39:56.293329Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761971996273 queuesize 0 startOffset 0
CallPersQueueGRPC response:
2025-11-01T04:39:56.293580Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808971992:3506] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1761971996273
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 15
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.295462Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.296413Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808971996:3508], now have 1 active actors on pipe
2025-11-01T04:39:56.296635Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.296667Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.296729Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|46cd45bc-fa7cffda-a713107a-17137357_0 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.296756Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.296774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.296783Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.296811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.296836Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.296866Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.297040Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.297551Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808971996:3508] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|46cd45bc-fa7cffda-a713107a-17137357_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|46cd45bc-fa7cffda-a713107a-17137357_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
  }
  MessageNo: 0
}
2025-11-01T04:39:56.299031Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.299768Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808971999:3509], now have 1 active actors on pipe
2025-11-01T04:39:56.299970Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.299991Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.300227Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-01T04:39:56.300265Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.300295Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.300323Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.300332Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.300403Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-01T04:39:56.301042Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-01T04:39:56.301091Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.301446Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1761971996301
2025-11-01T04:39:56.301548Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.301636Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-01T04:39:56.303735Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.303774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.303806Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.303806Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-01T04:39:56.303828Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.303851Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-01T04:39:56.303984Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:923: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-01T04:39:56.304004Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:965: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-01T04:39:56.304019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.304029Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.304036Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.304052Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.304077Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.304166Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037894][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic12' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-01T04:39:56.304228Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.304314Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037894][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-01T04:39:56.304330Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037894][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-01T04:39:56.304361Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:56.304381Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-01T04:39:56.304407Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:39:56.304413Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:39:56.304505Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-01T04:39:56.304559Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1015: Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp done, result 1761971996300 queuesize 0 startOffset 0
CallPersQueueGRPC response:
2025-11-01T04:39:56.304729Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808971999:3509] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1761971996300
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 1
    WriteTimeMs: 2
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.307200Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.308014Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972005:3513], now have 1 active actors on pipe
2025-11-01T04:39:56.308149Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.308171Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.308242Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|16a9bd86-f68ebe89-e68ed3a8-eb698f5f_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.308267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.308279Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.308287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.308319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.308344Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.308372Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.308472Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.308881Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972005:3513] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|16a9bd86-f68ebe89-e68ed3a8-eb698f5f_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|16a9bd86-f68ebe89-e68ed3a8-eb698f5f_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.326334Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.327511Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972008:3514], now have 1 active actors on pipe
2025-11-01T04:39:56.332095Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.332147Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.332540Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.332990Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.333077Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.333112Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.333362Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.333426Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.333457Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.333472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.333594Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-01T04:39:56.333635Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-01T04:39:56.333656Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-01T04:39:56.361621Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-01T04:39:56.361692Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.362261Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1761971996361
2025-11-01T04:39:56.363118Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:56.363140Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.363237Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.370142Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.370195Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.370225Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.370235Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.370254Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.370291Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-01T04:39:56.370301Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.370314Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-01T04:39:56.370328Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.370348Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-01T04:39:56.370724Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.370743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.370753Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.370777Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.370827Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.370983Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.371965Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972008:3514] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1761971996333
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 36
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.373526Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.374436Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972015:3518], now have 1 active actors on pipe
2025-11-01T04:39:56.374656Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.374684Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.374788Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bedfe13b-a3b876e5-791265d5-58c4c05d_1 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.374829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.374850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.374860Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.374887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.374921Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.374966Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.375076Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.375401Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972015:3518] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bedfe13b-a3b876e5-791265d5-58c4c05d_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|bedfe13b-a3b876e5-791265d5-58c4c05d_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.384618Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.384647Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.384660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.443047Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.444231Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972018:3519], now have 1 active actors on pipe
2025-11-01T04:39:56.448907Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.448962Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.449495Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.449984Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.450052Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.450083Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.450291Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.450348Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.450378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.450394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.450503Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-01T04:39:56.450545Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-01T04:39:56.450567Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-01T04:39:56.463399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.463420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.463430Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.471199Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-01T04:39:56.471267Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.471716Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1761971996471
2025-11-01T04:39:56.472526Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.472611Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.477963Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.478019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.478041Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.478055Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.478070Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.478092Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-01T04:39:56.478102Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.478115Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-01T04:39:56.478135Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.478152Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-01T04:39:56.478410Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.478426Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.478442Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.478464Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.478501Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.478638Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1761971996450
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 27
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:56.479932Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972018:3519] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.481334Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.482185Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972028:3526], now have 1 active actors on pipe
2025-11-01T04:39:56.482358Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.482381Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.482443Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e3cc77ac-f38e1a37-81b979e0-d0adde11_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.482466Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.482481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.482489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.482516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.482542Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.482569Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.482672Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.483083Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972028:3526] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e3cc77ac-f38e1a37-81b979e0-d0adde11_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:56.484899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.484916Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.484924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e3cc77ac-f38e1a37-81b979e0-d0adde11_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.499384Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.500388Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972031:3527], now have 1 active actors on pipe
2025-11-01T04:39:56.502984Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.503014Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.503363Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.503718Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.503742Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.503759Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.503926Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.503964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.503985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.503997Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.504071Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-01T04:39:56.504096Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-01T04:39:56.504106Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-01T04:39:56.518808Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-01T04:39:56.518871Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.519316Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1761971996519
2025-11-01T04:39:56.520101Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.520182Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.525664Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.525705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.525737Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.525752Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.525750Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.525773Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-01T04:39:56.525781Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.525798Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-01T04:39:56.525831Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.525853Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-01T04:39:56.526296Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.526323Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.526330Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.526351Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.526394Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.526573Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1761971996503
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:56.527879Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972031:3527] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.529080Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.529940Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972037:3531], now have 1 active actors on pipe
2025-11-01T04:39:56.530121Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.530141Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.530209Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|1476d103-9866f781-46723f22-59febf8e_2 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.530232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.530257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.530268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.530295Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.530321Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.530351Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.530499Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.530949Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972037:3531] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|1476d103-9866f781-46723f22-59febf8e_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|1476d103-9866f781-46723f22-59febf8e_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.544738Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.545762Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972040:3532], now have 1 active actors on pipe
2025-11-01T04:39:56.548814Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.548864Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.549377Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.549854Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.549895Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.549918Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.550224Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.550276Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.550306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.550324Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.550429Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-01T04:39:56.550475Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-01T04:39:56.550501Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-01T04:39:56.563795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.563818Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.563828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.582094Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-01T04:39:56.582159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.582623Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1761971996582
2025-11-01T04:39:56.583413Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.583503Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.585293Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037894][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:56.589718Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.589779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.589811Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.589826Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.589847Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.589880Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-01T04:39:56.589896Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.589914Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-01T04:39:56.589932Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.589950Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-01T04:39:56.590315Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.590347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.590359Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.590391Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.590453Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.590661Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1761971996549
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.592116Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972040:3532] destroyed
2025-11-01T04:39:56.593162Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.593998Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972045:3535], now have 1 active actors on pipe
2025-11-01T04:39:56.594207Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.594234Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.594320Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d169386c-b461a6d2-501b7058-d6375a9_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.594352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.594369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.594381Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.594414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.594454Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.594490Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.594615Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d169386c-b461a6d2-501b7058-d6375a9_3"
    Status: Active
    SeqNo: 0
  }
}
2025-11-01T04:39:56.595103Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972045:3535] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d169386c-b461a6d2-501b7058-d6375a9_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.620110Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.621101Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972048:3536], now have 1 active actors on pipe
2025-11-01T04:39:56.624012Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.624052Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.624415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.624769Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.624799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.624820Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.625006Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.625067Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.625094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.625110Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.625209Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-01T04:39:56.625243Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-01T04:39:56.625259Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-01T04:39:56.643494Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-01T04:39:56.643573Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.644111Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1761971996644
2025-11-01T04:39:56.644929Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.645033Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.650048Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.650094Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.650133Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.650140Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.650151Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.650175Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-01T04:39:56.650194Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.650205Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-01T04:39:56.650220Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.650237Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-01T04:39:56.650497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.650516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.650525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.650546Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.650590Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.650738Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.651686Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972048:3536] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1761971996624
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.653014Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.653795Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972055:3541], now have 1 active actors on pipe
2025-11-01T04:39:56.653957Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.654010Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.654118Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e0009852-7d753433-96a0109b-340ea635_3 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.654156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.654175Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.654186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.654219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.654263Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.654310Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.654441Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e0009852-7d753433-96a0109b-340ea635_3"
    Status: Active
    SeqNo: 0
  }
}
2025-11-01T04:39:56.654888Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972055:3541] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|e0009852-7d753433-96a0109b-340ea635_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.664156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.664189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.664201Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.669546Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.670383Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972058:3542], now have 1 active actors on pipe
2025-11-01T04:39:56.673402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.673446Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.673898Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.674250Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.674279Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.674301Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.674489Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.674549Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.674581Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.674597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.674703Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-01T04:39:56.674750Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-01T04:39:56.674775Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-01T04:39:56.693861Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-01T04:39:56.693947Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.694580Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1761971996694
2025-11-01T04:39:56.695420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037894][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:56.695445Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.695546Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.701330Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.701380Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.701420Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.701438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.701456Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.701464Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-01T04:39:56.701475Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.701487Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-01T04:39:56.701505Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.701517Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-01T04:39:56.701779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.701799Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.701808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.701831Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.701880Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.702268Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1761971996674
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 26
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.703443Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972058:3542] destroyed
2025-11-01T04:39:56.704538Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.705345Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972064:3546], now have 1 active actors on pipe
2025-11-01T04:39:56.705699Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.705730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.705806Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|eb9fab83-9d58af35-f10591a8-ffcbc241_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.705834Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.705851Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.705861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.705894Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.705926Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.705959Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.706048Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.706409Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972064:3546] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|eb9fab83-9d58af35-f10591a8-ffcbc241_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|eb9fab83-9d58af35-f10591a8-ffcbc241_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.720720Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.721858Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972067:3547], now have 1 active actors on pipe
2025-11-01T04:39:56.724763Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.724799Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.725184Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.725561Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.725595Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.725617Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.725861Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.725907Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.725938Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.725958Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.726054Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-01T04:39:56.726089Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-01T04:39:56.726102Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-01T04:39:56.733926Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-01T04:39:56.733999Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.734622Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1761971996734
2025-11-01T04:39:56.735369Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.735473Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.740896Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.740944Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.740983Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.740984Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.741004Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.741031Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-01T04:39:56.741044Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.741073Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-01T04:39:56.741093Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.741110Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-01T04:39:56.741381Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.741399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.741409Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.741432Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.741479Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.741628Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1761971996725
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.742964Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972067:3547] destroyed
2025-11-01T04:39:56.744308Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.745242Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972072:3550], now have 1 active actors on pipe
2025-11-01T04:39:56.745423Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.745448Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.745527Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cd516560-6d22def8-71400e97-ad6736d_4 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.745557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.745576Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.745600Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.745636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.745671Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.745707Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.745825Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.746207Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972072:3550] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cd516560-6d22def8-71400e97-ad6736d_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|cd516560-6d22def8-71400e97-ad6736d_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.764219Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.764478Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.764502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.764513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.765251Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972078:3551], now have 1 active actors on pipe
2025-11-01T04:39:56.767918Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.767959Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.768302Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.768641Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.768670Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.768689Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.768896Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.768944Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.768966Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.768975Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.769075Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-01T04:39:56.769110Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-01T04:39:56.769126Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-01T04:39:56.771968Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-01T04:39:56.772032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.772646Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1761971996772
2025-11-01T04:39:56.773504Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.773617Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.778998Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.779046Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.779082Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.779089Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.779108Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.779133Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-01T04:39:56.779143Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.779158Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-01T04:39:56.779176Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.779197Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-01T04:39:56.779494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.779512Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.779521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.779560Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.779641Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.779794Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:56.781200Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972078:3551] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1761971996768
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.786730Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.787654Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972083:3554], now have 1 active actors on pipe
2025-11-01T04:39:56.788029Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.788064Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.788134Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|878426b3-1601768-25871374-8421a676_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.788163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.788178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.788188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.788220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.788251Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.788286Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.788519Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.788885Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972083:3554] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|878426b3-1601768-25871374-8421a676_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|878426b3-1601768-25871374-8421a676_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.795686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.795710Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.795721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.801834Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.802663Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972086:3555], now have 1 active actors on pipe
2025-11-01T04:39:56.805333Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.805385Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.805871Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.806346Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.806395Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.806427Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.806700Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.806771Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.806812Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.806836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.806968Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-01T04:39:56.807030Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-01T04:39:56.807063Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-01T04:39:56.813698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-01T04:39:56.813768Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.814300Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1761971996814
2025-11-01T04:39:56.815062Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.815164Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.820604Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.820651Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.820689Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.820692Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.820710Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.820736Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-01T04:39:56.820747Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.820759Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-01T04:39:56.820775Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.820788Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-01T04:39:56.821115Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.821134Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.821143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.821168Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.821225Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.821412Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.822369Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972086:3555] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1761971996806
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 13
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.823909Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.824829Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972093:3560], now have 1 active actors on pipe
2025-11-01T04:39:56.825022Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.825058Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.825128Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|41d82c59-a7b361be-de308c1a-28e11f74_5 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.825164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.825178Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.825187Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.825220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.825251Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.825285Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.825422Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.825900Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972093:3560] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|41d82c59-a7b361be-de308c1a-28e11f74_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|41d82c59-a7b361be-de308c1a-28e11f74_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.841013Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.842085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972096:3561], now have 1 active actors on pipe
2025-11-01T04:39:56.844918Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.844955Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.845335Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.845673Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.845699Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.845719Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.845938Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.845993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.846016Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.846034Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.846127Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-01T04:39:56.846160Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-01T04:39:56.846170Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-01T04:39:56.851416Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-01T04:39:56.851481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.852047Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1761971996851
2025-11-01T04:39:56.852851Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.852951Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.858626Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.858673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.858705Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.858716Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.858735Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.858761Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-01T04:39:56.858771Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.858784Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-01T04:39:56.858799Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.858814Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-01T04:39:56.859097Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.859130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.859139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.859161Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.859207Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.859410Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1761971996845
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.860957Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972096:3561] destroyed
2025-11-01T04:39:56.862014Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.863096Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972102:3565], now have 1 active actors on pipe
2025-11-01T04:39:56.863305Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.863328Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.863393Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|adc6918f-49f756de-7c024873-acea8d66_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.863419Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.863438Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.863450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.863482Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.863514Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.863540Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.863699Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|adc6918f-49f756de-7c024873-acea8d66_6"
    Status: Active
    SeqNo: 0
  }
}
2025-11-01T04:39:56.864151Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972102:3565] destroyed
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:56.864743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.864761Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.864771Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|adc6918f-49f756de-7c024873-acea8d66_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.879927Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.881077Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972105:3566], now have 1 active actors on pipe
2025-11-01T04:39:56.884616Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.884651Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.885065Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.885422Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.885459Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.885483Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.885671Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.885715Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.885750Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.885768Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.885858Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-01T04:39:56.885891Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-01T04:39:56.885907Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-01T04:39:56.888732Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-01T04:39:56.888782Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.892730Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1761971996892
2025-11-01T04:39:56.893482Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.893581Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.896041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.896059Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.896069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.899023Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.899067Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.899104Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.899121Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.899137Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.899145Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-01T04:39:56.899154Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.899166Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-01T04:39:56.899182Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.899195Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-01T04:39:56.899460Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.899479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.899488Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.899506Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.899550Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.899757Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1761971996885
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 13
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:56.901018Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972105:3566] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.902364Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.903274Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972110:3569], now have 1 active actors on pipe
2025-11-01T04:39:56.903511Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.903535Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.903600Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e081491b-abcb8103-5137a3c4-bf4a59d2_6 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.903641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.903660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.903676Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.903705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.903736Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.903766Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.903909Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.904407Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972110:3569] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e081491b-abcb8103-5137a3c4-bf4a59d2_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|e081491b-abcb8103-5137a3c4-bf4a59d2_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.917125Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.918190Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972113:3570], now have 1 active actors on pipe
2025-11-01T04:39:56.921501Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.921541Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.921907Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.922239Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.922265Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.922286Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.922452Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.922504Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.922528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.922541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.922637Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-01T04:39:56.922670Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-01T04:39:56.922686Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-01T04:39:56.927261Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-01T04:39:56.927319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.927879Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1761971996927
2025-11-01T04:39:56.928586Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.928684Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.934092Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:56.934137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.934170Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.934175Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.934192Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.934216Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-01T04:39:56.934230Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.934242Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-01T04:39:56.934257Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.934271Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-01T04:39:56.934543Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.934560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.934569Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.934592Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.934648Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.934795Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1761971996922
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:56.936068Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972113:3570] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.937275Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.938130Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972121:3573], now have 1 active actors on pipe
2025-11-01T04:39:56.938296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.938321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.938396Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b81ac136-46eee76a-27196afc-bc2b35ed_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:56.938424Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.938437Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.938449Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.938498Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.938528Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.938559Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.938677Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b81ac136-46eee76a-27196afc-bc2b35ed_7"
    Status: Active
    SeqNo: 0
  }
}
2025-11-01T04:39:56.939173Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972121:3573] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b81ac136-46eee76a-27196afc-bc2b35ed_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.952962Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.953819Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612102808972127:3577], now have 1 active actors on pipe
2025-11-01T04:39:56.956508Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:56.956542Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:56.956899Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.957289Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.957316Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.957336Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.957544Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.957589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.957612Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.957622Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.957718Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-01T04:39:56.957749Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-01T04:39:56.957764Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-01T04:39:56.961667Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-01T04:39:56.961719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.962288Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1761971996962
2025-11-01T04:39:56.963042Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:56.963149Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-01T04:39:56.965123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:56.968407Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:56.968451Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:56.968486Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:56.968506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.968520Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:56.968532Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-01T04:39:56.968541Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.968556Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-01T04:39:56.968572Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:56.968587Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-01T04:39:56.968853Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.968870Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.968879Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.968904Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:56.968950Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.969131Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1761971996957
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:56.970375Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612102808972127:3577] destroyed
2025-11-01T04:39:56.971638Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.972563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972132:3580], now have 1 active actors on pipe
2025-11-01T04:39:56.972789Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.972815Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.972885Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a85bb5b0-fe9a163d-3c641d4d-93b1b859_7 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:56.972912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.972935Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.972944Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:56.972975Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.973007Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:56.973043Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:56.973181Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:56.973590Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972132:3580] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a85bb5b0-fe9a163d-3c641d4d-93b1b859_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|a85bb5b0-fe9a163d-3c641d4d-93b1b859_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:56.992748Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:56.993603Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612102808972143:3586], now have 1 active actors on pipe
2025-11-01T04:39:56.996839Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:56.996886Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:56.997300Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:56.997682Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:56.997711Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:56.997729Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:56.998105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.998124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.998138Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:56.998174Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:56.998211Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:56.998229Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:56.998239Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:56.998325Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-01T04:39:56.998365Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-01T04:39:56.998382Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-01T04:39:57.001469Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-01T04:39:57.001525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.002063Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1761971997001
2025-11-01T04:39:57.002880Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.002982Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.008548Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.008620Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.008665Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.008664Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.008687Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.008711Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-01T04:39:57.008722Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.008735Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-01T04:39:57.008752Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.008764Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-01T04:39:57.009204Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.009222Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.009231Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.009254Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.009301Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.009457Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.011130Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612102808972143:3586] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1761971996997
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.012536Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.013410Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939453:3594], now have 1 active actors on pipe
2025-11-01T04:39:57.013640Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.013673Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.013753Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5a83ecec-766fc011-a577aedc-7aeb8f0d_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.013786Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.013803Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.013812Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.013845Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.013879Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.013915Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.014057Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.014520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939453:3594] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5a83ecec-766fc011-a577aedc-7aeb8f0d_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5a83ecec-766fc011-a577aedc-7aeb8f0d_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.028151Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.029085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939456:3595], now have 1 active actors on pipe
2025-11-01T04:39:57.032557Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.032597Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.033007Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.033376Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.033404Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.033425Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.033787Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.033837Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.033860Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.033869Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.033958Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-01T04:39:57.033988Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-01T04:39:57.034004Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-01T04:39:57.039028Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-01T04:39:57.039096Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.039708Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1761971997039
2025-11-01T04:39:57.040437Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.040540Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.047317Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.047376Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.047426Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.047436Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.047451Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.047490Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-01T04:39:57.047506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.047528Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-01T04:39:57.047549Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.047569Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-01T04:39:57.048034Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.048054Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.048064Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.048109Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-01T04:39:57.048119Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048127Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048134Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048144Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048152Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048159Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048169Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048176Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.048193Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-01T04:39:57.048249Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.048293Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-01T04:39:57.048324Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-01T04:39:57.048472Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-01T04:39:57.048481Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.048626Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-01T04:39:57.048740Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-01T04:39:57.048839Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-01T04:39:57.049103Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-01T04:39:57.049190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-01T04:39:57.049286Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-01T04:39:57.049374Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-01T04:39:57.049717Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 9 blobs for compaction
CallPersQueueGRPC response:
2025-11-01T04:39:57.049786Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049811Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049831Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049850Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049869Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049887Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049905Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1761971997033
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 13
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:57.049926Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.049940Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:57.000000Z
2025-11-01T04:39:57.049988Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:57.050056Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:39:57.050085Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-01T04:39:57.050094Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.050124Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050131Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-01T04:39:57.050149Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.050159Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050178Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-01T04:39:57.050204Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050212Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/1
2025-11-01T04:39:57.050242Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050250Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-01T04:39:57.050288Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050328Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050354Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.050894Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-01T04:39:57.050921Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-11-01T04:39:57.050938Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-01T04:39:57.050948Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.050958Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-01T04:39:57.051285Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.051695Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-11-01T04:39:57.051721Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-01T04:39:57.051730Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-11-01T04:39:57.052680Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-11-01T04:39:57.052704Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-01T04:39:57.052713Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-11-01T04:39:57.052880Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-11-01T04:39:57.052895Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-01T04:39:57.056887Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048955 count 2 nextOffset 2 batches 3
2025-11-01T04:39:57.056927Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-11-01T04:39:57.056947Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-01T04:39:57.056955Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.056968Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-01T04:39:57.057701Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-11-01T04:39:57.057739Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-01T04:39:57.057756Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-11-01T04:39:57.058656Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-11-01T04:39:57.058686Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-01T04:39:57.058699Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-11-01T04:39:57.058933Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-11-01T04:39:57.058954Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-01T04:39:57.061167Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097711 count 3 nextOffset 3 batches 5
2025-11-01T04:39:57.061213Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-11-01T04:39:57.061241Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-01T04:39:57.061253Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.061270Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-01T04:39:57.062124Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-11-01T04:39:57.062150Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-01T04:39:57.062159Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-11-01T04:39:57.063162Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-11-01T04:39:57.063190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-01T04:39:57.063204Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-11-01T04:39:57.063402Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-11-01T04:39:57.063425Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-01T04:39:57.068906Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146466 count 4 nextOffset 4 batches 7
2025-11-01T04:39:57.068954Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-11-01T04:39:57.068982Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-01T04:39:57.068993Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.069011Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-01T04:39:57.069814Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-11-01T04:39:57.069840Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-01T04:39:57.069851Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-11-01T04:39:57.070701Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-11-01T04:39:57.070722Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-01T04:39:57.070733Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-11-01T04:39:57.070938Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-11-01T04:39:57.070956Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-01T04:39:57.073209Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195221 count 5 nextOffset 5 batches 9
2025-11-01T04:39:57.073249Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-11-01T04:39:57.073272Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-01T04:39:57.073280Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.073293Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-01T04:39:57.074167Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-11-01T04:39:57.074192Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-01T04:39:57.074201Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-11-01T04:39:57.075066Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-11-01T04:39:57.075088Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-01T04:39:57.075097Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-11-01T04:39:57.075290Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-11-01T04:39:57.075306Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-01T04:39:57.081359Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243976 count 6 nextOffset 6 batches 11
2025-11-01T04:39:57.081412Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-11-01T04:39:57.081438Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-01T04:39:57.081448Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.081465Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-01T04:39:57.082189Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-11-01T04:39:57.082223Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-01T04:39:57.082237Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-11-01T04:39:57.083076Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-11-01T04:39:57.083102Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-01T04:39:57.083115Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-11-01T04:39:57.083329Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-11-01T04:39:57.083351Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-01T04:39:57.085364Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292731 count 7 nextOffset 7 batches 13
2025-11-01T04:39:57.085402Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-11-01T04:39:57.088404Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-01T04:39:57.088423Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.088440Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-01T04:39:57.089143Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-11-01T04:39:57.089177Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-01T04:39:57.089190Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-11-01T04:39:57.090059Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-11-01T04:39:57.090085Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-01T04:39:57.090096Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-11-01T04:39:57.090294Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-11-01T04:39:57.090312Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-01T04:39:57.092241Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341486 count 8 nextOffset 8 batches 15
2025-11-01T04:39:57.092279Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-11-01T04:39:57.092302Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-01T04:39:57.092312Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.092330Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-01T04:39:57.093042Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-11-01T04:39:57.093083Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-01T04:39:57.093093Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-11-01T04:39:57.093985Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-11-01T04:39:57.094011Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-01T04:39:57.094024Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-11-01T04:39:57.094233Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-11-01T04:39:57.094255Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-01T04:39:57.132668Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365505
2025-11-01T04:39:57.132759Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365505 WTime 1761971997132
2025-11-01T04:39:57.139059Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-01T04:39:57.139114Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-11-01T04:39:57.139775Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1761971997139
2025-11-01T04:39:57.139958Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939461:3598], now have 1 active actors on pipe
2025-11-01T04:39:57.140027Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.140054Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.140105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.140124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.140136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.140228Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|4f4d8075-c00034a8-bb00ff36-4eee5792_8 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.140258Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.140273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.140285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.140325Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.140353Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.140383Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.140471Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939456:3595] destroyed
2025-11-01T04:39:57.140496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.140506Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.140515Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.140542Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.140565Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.140660Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365505
2025-11-01T04:39:57.140735Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
CallPersQueueGRPC response:
2025-11-01T04:39:57.141226Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939461:3598] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|4f4d8075-c00034a8-bb00ff36-4eee5792_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|4f4d8075-c00034a8-bb00ff36-4eee5792_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.155778Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.156615Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939467:3601], now have 1 active actors on pipe
2025-11-01T04:39:57.159004Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365505 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.159047Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.159104Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.159167Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365505
2025-11-01T04:39:57.159215Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-01T04:39:57.159433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.159461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.159478Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.159692Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.159727Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.159767Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-01T04:39:57.159796Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159810Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159819Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159828Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159836Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159844Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159853Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-01T04:39:57.159862Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-01T04:39:57.162068Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.162129Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.162587Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.163023Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.163062Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.163091Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.163517Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.163578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.163607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.163652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.163770Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-01T04:39:57.163814Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-01T04:39:57.163835Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-01T04:39:57.168777Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-01T04:39:57.168861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.169582Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1761971997169
2025-11-01T04:39:57.170595Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.170725Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.171077Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171121Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171161Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171192Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171226Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171256Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171291Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171322Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171355Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.171429Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.171478Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.171488Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-01T04:39:57.171516Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.171516Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.171540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.171561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.171612Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.171939Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.172294Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.172663Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.173083Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.173515Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.173908Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.174327Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.178072Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.178132Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.178156Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.178181Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.178206Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.178243Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-01T04:39:57.178257Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.178280Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-01T04:39:57.178303Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.178324Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-01T04:39:57.178887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.178912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.178926Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.178965Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-01T04:39:57.178982Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.178996Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179007Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179025Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179041Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179052Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179067Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179077Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-01T04:39:57.179088Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037894][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-01T04:39:57.179157Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.179205Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037894][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-01T04:39:57.179225Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-01T04:39:57.179337Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-01T04:39:57.179350Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.179478Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-01T04:39:57.179677Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-01T04:39:57.179851Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-01T04:39:57.180351Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-01T04:39:57.180529Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
CallPersQueueGRPC response:
2025-11-01T04:39:57.180709Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1761971997163
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:57.180855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.181339Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037894][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-01T04:39:57.181387Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939467:3601] destroyed
2025-11-01T04:39:57.181434Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181459Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181480Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181496Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181520Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181541Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181562Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:56.000000Z
2025-11-01T04:39:57.181583Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:57.000000Z
2025-11-01T04:39:57.181600Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-01T04:39:57.000000Z
2025-11-01T04:39:57.181657Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-01T04:39:57.181731Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-01T04:39:57.181757Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037894][Partition][0][StateIdle] Continue blobs compaction
2025-11-01T04:39:57.181768Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181788Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181790Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-01T04:39:57.181801Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.181814Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181815Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-01T04:39:57.181834Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181846Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 0.0/1
2025-11-01T04:39:57.181854Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181873Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181874Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-01T04:39:57.181893Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.181915Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-01T04:39:57.182357Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.189526Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-01T04:39:57.189567Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 0:0 appended
2025-11-01T04:39:57.189596Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-01T04:39:57.189607Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.189624Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-01T04:39:57.190539Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.0/3
2025-11-01T04:39:57.190584Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-01T04:39:57.190600Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:0 appended
2025-11-01T04:39:57.191665Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.1/3
2025-11-01T04:39:57.191695Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-01T04:39:57.191708Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:1 appended
2025-11-01T04:39:57.191932Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.2/3
2025-11-01T04:39:57.191952Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-01T04:39:57.194472Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048956 count 2 nextOffset 2 batches 3
2025-11-01T04:39:57.194517Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:2 appended
2025-11-01T04:39:57.194544Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-01T04:39:57.194554Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.194573Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-01T04:39:57.195519Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.0/3
2025-11-01T04:39:57.195557Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-01T04:39:57.195570Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:0 appended
2025-11-01T04:39:57.196703Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.1/3
2025-11-01T04:39:57.196737Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-01T04:39:57.196750Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:1 appended
2025-11-01T04:39:57.196974Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.2/3
2025-11-01T04:39:57.196996Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-01T04:39:57.205673Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097711 count 3 nextOffset 3 batches 5
2025-11-01T04:39:57.205734Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:2 appended
2025-11-01T04:39:57.205762Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-01T04:39:57.205773Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.205790Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-01T04:39:57.205838Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939475:3607], now have 1 active actors on pipe
2025-11-01T04:39:57.205899Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.205919Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.205988Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5301561d-c3dd7230-652c9fbd-6e9e9d2e_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.206015Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.206032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.206040Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.206065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.206097Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.206127Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.206239Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.206670Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.0/3
2025-11-01T04:39:57.206719Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-01T04:39:57.206735Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:0 appended
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5301561d-c3dd7230-652c9fbd-6e9e9d2e_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:57.207887Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.1/3
2025-11-01T04:39:57.207919Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-01T04:39:57.207933Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:1 appended
2025-11-01T04:39:57.208226Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.2/3
2025-11-01T04:39:57.208250Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-01T04:39:57.210783Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939475:3607] destroyed
2025-11-01T04:39:57.211350Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146466 count 4 nextOffset 4 batches 7
2025-11-01T04:39:57.211412Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:2 appended
2025-11-01T04:39:57.211442Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-01T04:39:57.211462Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.211479Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5301561d-c3dd7230-652c9fbd-6e9e9d2e_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.212884Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.0/3
2025-11-01T04:39:57.212952Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-01T04:39:57.212977Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:0 appended
2025-11-01T04:39:57.214359Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.1/3
2025-11-01T04:39:57.214391Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-01T04:39:57.214406Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:1 appended
2025-11-01T04:39:57.214759Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.2/3
2025-11-01T04:39:57.214784Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-01T04:39:57.218536Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195221 count 5 nextOffset 5 batches 9
2025-11-01T04:39:57.218593Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:2 appended
2025-11-01T04:39:57.218621Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-01T04:39:57.218632Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.218650Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-01T04:39:57.219695Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.0/3
2025-11-01T04:39:57.219736Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-01T04:39:57.219749Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:0 appended
2025-11-01T04:39:57.220852Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.1/3
2025-11-01T04:39:57.220884Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-01T04:39:57.220899Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:1 appended
2025-11-01T04:39:57.221130Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.2/3
2025-11-01T04:39:57.221154Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-01T04:39:57.223139Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.223908Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939507:3618], now have 1 active actors on pipe
2025-11-01T04:39:57.226532Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.226567Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.226930Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.227318Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.227357Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.227372Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.227701Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.227749Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.227768Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.227776Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.227855Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-01T04:39:57.227887Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-01T04:39:57.227898Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-01T04:39:57.230635Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243976 count 6 nextOffset 6 batches 11
2025-11-01T04:39:57.230695Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:2 appended
2025-11-01T04:39:57.230727Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-01T04:39:57.230738Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.230757Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-01T04:39:57.230987Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-01T04:39:57.231034Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.232274Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.0/3
2025-11-01T04:39:57.232326Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-01T04:39:57.232342Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:0 appended
2025-11-01T04:39:57.233415Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.1/3
2025-11-01T04:39:57.233449Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-01T04:39:57.233462Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:1 appended
2025-11-01T04:39:57.233684Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.2/3
2025-11-01T04:39:57.233706Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-01T04:39:57.236122Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1761971997235
2025-11-01T04:39:57.237088Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.237177Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.237411Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292731 count 7 nextOffset 7 batches 13
2025-11-01T04:39:57.237457Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:2 appended
2025-11-01T04:39:57.237486Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-01T04:39:57.237503Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.237521Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-01T04:39:57.238521Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.0/3
2025-11-01T04:39:57.238564Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-01T04:39:57.238577Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:0 appended
2025-11-01T04:39:57.239751Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.1/3
2025-11-01T04:39:57.239785Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-01T04:39:57.239798Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:1 appended
2025-11-01T04:39:57.240050Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.2/3
2025-11-01T04:39:57.240072Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-01T04:39:57.240656Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:57.242361Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.242398Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.242430Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.242440Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.242445Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.242466Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-01T04:39:57.242475Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.242487Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-01T04:39:57.242499Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.242510Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-01T04:39:57.242898Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.242916Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.242924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.242945Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.242980Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.243145Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.244203Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939507:3618] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1761971997227
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.245853Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.251200Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341486 count 8 nextOffset 8 batches 15
2025-11-01T04:39:57.251272Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:2 appended
2025-11-01T04:39:57.251303Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-01T04:39:57.251315Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-01T04:39:57.251332Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-01T04:39:57.252274Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.0/3
2025-11-01T04:39:57.252325Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-01T04:39:57.252341Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:0 appended
2025-11-01T04:39:57.253371Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.1/3
2025-11-01T04:39:57.253403Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-01T04:39:57.253418Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:1 appended
2025-11-01T04:39:57.253563Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.2/3
2025-11-01T04:39:57.253585Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-01T04:39:57.298018Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365505
2025-11-01T04:39:57.298061Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037894][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic12' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365505 WTime 1761971997297
2025-11-01T04:39:57.301591Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-01T04:39:57.301619Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:2 appended
2025-11-01T04:39:57.301901Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1761971997301
2025-11-01T04:39:57.302019Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.302033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.302043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.302084Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939512:3621], now have 1 active actors on pipe
2025-11-01T04:39:57.302135Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.302163Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.302191Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.302263Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365505
2025-11-01T04:39:57.302307Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-01T04:39:57.302368Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8a975eb4-8057951f-d836f220-3be8f9fb_9 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.302390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.302402Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.302409Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.302432Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.302453Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.302533Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.302665Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.303172Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939512:3621] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8a975eb4-8057951f-d836f220-3be8f9fb_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|8a975eb4-8057951f-d836f220-3be8f9fb_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.317464Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.318125Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939518:3624], now have 1 active actors on pipe
2025-11-01T04:39:57.318316Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365505 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.318346Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.318385Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.318409Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365505
2025-11-01T04:39:57.318431Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-01T04:39:57.318545Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.318558Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.318563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.318647Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.318666Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.318679Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-01T04:39:57.318685Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318691Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318697Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318702Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318709Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318714Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318719Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-01T04:39:57.318724Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-01T04:39:57.321564Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.321601Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.322086Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.322521Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.322549Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.322563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.322847Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.322891Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037894][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:57.322949Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.322974Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.322993Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323012Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323034Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323057Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323075Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323097Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323121Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.323153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.323175Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-01T04:39:57.323182Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.323196Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.323199Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.323218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.323235Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.323361Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-01T04:39:57.323401Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-01T04:39:57.323427Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-01T04:39:57.323661Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.323986Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.324299Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.324566Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.324845Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.325137Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.325409Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.329260Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-01T04:39:57.329314Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.329918Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1761971997329
2025-11-01T04:39:57.330611Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.330831Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.330910Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.335335Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.335387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.335420Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.335425Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.335433Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.335454Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-01T04:39:57.335464Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.335476Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-01T04:39:57.335490Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.335503Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-01T04:39:57.335759Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.335776Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.335785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.335805Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.335844Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.336011Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1761971997322
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.337313Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939518:3624] destroyed
2025-11-01T04:39:57.338316Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.338975Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939525:3630], now have 1 active actors on pipe
2025-11-01T04:39:57.339137Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.339160Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.339219Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2d33dcf6-dac1607c-e6948e2c-f824b03d_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.339243Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.339254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.339263Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.339298Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.339328Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.339356Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.339442Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.339843Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939525:3630] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2d33dcf6-dac1607c-e6948e2c-f824b03d_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:57.340981Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.341001Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.341013Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2d33dcf6-dac1607c-e6948e2c-f824b03d_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.353313Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.354172Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939528:3631], now have 1 active actors on pipe
2025-11-01T04:39:57.357179Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.357226Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.357689Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.358137Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.358179Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.358203Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.358497Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.358554Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.358583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.358596Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.358709Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-01T04:39:57.358753Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-01T04:39:57.358775Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-01T04:39:57.364269Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-01T04:39:57.364335Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.364994Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1761971997364
2025-11-01T04:39:57.366004Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.366119Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.371166Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.371213Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.371245Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.371248Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.371263Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.371284Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-01T04:39:57.371294Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.371308Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-01T04:39:57.371323Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.371337Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-01T04:39:57.371590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.371607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.371615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.371645Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.371684Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.371838Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1761971997358
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.372978Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939528:3631] destroyed
2025-11-01T04:39:57.374104Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.374842Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939533:3634], now have 1 active actors on pipe
2025-11-01T04:39:57.374982Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.375002Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.375063Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9a24b4b8-4fb1c7c-f65b7c4b-77c824b5_10 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.375087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.375101Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.375110Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.375137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.375159Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.375187Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.375276Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.375647Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939533:3634] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9a24b4b8-4fb1c7c-f65b7c4b-77c824b5_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|9a24b4b8-4fb1c7c-f65b7c4b-77c824b5_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.390890Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.391787Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939537:3636], now have 1 active actors on pipe
2025-11-01T04:39:57.394483Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.394513Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.394880Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.395265Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.395297Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.395312Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.395543Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.395580Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.395607Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.395633Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.395724Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-01T04:39:57.395755Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-01T04:39:57.395766Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-01T04:39:57.398523Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-01T04:39:57.398572Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.399110Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1761971997398
2025-11-01T04:39:57.399922Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.400023Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.402416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037894][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:57.405146Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.405185Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.405227Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.405237Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.405242Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.405264Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-01T04:39:57.405274Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.405286Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-01T04:39:57.405299Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.405312Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-01T04:39:57.405584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.405599Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.405608Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.405627Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.405665Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.405835Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1761971997395
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.408594Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939537:3636] destroyed
2025-11-01T04:39:57.408844Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.409548Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939542:3639], now have 1 active actors on pipe
2025-11-01T04:39:57.409730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.409752Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.409813Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bc0e16ff-fdb9246-ec6ce146-1c752468_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.409838Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.409859Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.409876Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.409903Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.409931Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.409961Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.410049Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.410396Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939542:3639] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bc0e16ff-fdb9246-ec6ce146-1c752468_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|bc0e16ff-fdb9246-ec6ce146-1c752468_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.423677Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.424459Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939545:3640], now have 1 active actors on pipe
2025-11-01T04:39:57.427384Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.427416Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.427797Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.428164Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.428193Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.428210Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.428463Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.428504Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.428523Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.428531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.428605Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-01T04:39:57.428632Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-01T04:39:57.428643Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-01T04:39:57.431863Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-01T04:39:57.431912Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.432403Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1761971997432
2025-11-01T04:39:57.433128Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.433245Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.438170Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.438234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.438291Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.438310Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.438317Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.438350Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-01T04:39:57.438364Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.438382Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-01T04:39:57.438404Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.438427Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-01T04:39:57.438802Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.438842Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.438854Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.438884Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.438945Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.439125Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.440263Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939545:3640] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1761971997428
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.441334Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.441357Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.441370Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.441592Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.442366Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939550:3643], now have 1 active actors on pipe
2025-11-01T04:39:57.442575Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.442600Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.442666Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9fd147bd-5af499f1-e189dc86-56ac6598_11 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.442688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.442704Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.442712Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.442739Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.442775Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.442804Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.442906Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.443259Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939550:3643] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9fd147bd-5af499f1-e189dc86-56ac6598_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|9fd147bd-5af499f1-e189dc86-56ac6598_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.459893Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.460944Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939555:3645], now have 1 active actors on pipe
2025-11-01T04:39:57.464815Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.464867Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.465354Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.465814Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.465849Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.465876Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.466103Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.466154Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.466180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.466195Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.466297Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-01T04:39:57.466337Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-01T04:39:57.466358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-01T04:39:57.470152Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-01T04:39:57.470216Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.470873Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1761971997470
2025-11-01T04:39:57.471789Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.471907Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.477232Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.477292Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.477334Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.477335Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.477355Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.477386Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-01T04:39:57.477406Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.477426Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-01T04:39:57.477446Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.477464Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-01T04:39:57.477817Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.477840Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.477852Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.477879Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.477939Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.478115Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1761971997465
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.479172Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939555:3645] destroyed
2025-11-01T04:39:57.480362Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.481286Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939561:3649], now have 1 active actors on pipe
2025-11-01T04:39:57.481484Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.481512Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.481590Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|614c7c54-be504043-2258dbba-cb040e01_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.481621Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.481640Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.481652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.481687Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.481722Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.481766Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.481896Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.482303Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939561:3649] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|614c7c54-be504043-2258dbba-cb040e01_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|614c7c54-be504043-2258dbba-cb040e01_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.495938Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.496891Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939564:3650], now have 1 active actors on pipe
2025-11-01T04:39:57.499971Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.500016Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.500474Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.500907Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.500948Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.500974Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.501248Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.501300Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.501328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.501341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.501440Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-01T04:39:57.501478Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-01T04:39:57.501498Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-01T04:39:57.502806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.502835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.502847Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.508056Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-01T04:39:57.508128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.508808Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1761971997508
2025-11-01T04:39:57.509820Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.509936Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.515466Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.515529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.515575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.515587Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.515599Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.515641Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-01T04:39:57.515658Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.515679Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-01T04:39:57.515701Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.515747Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-01T04:39:57.516098Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.516121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.516133Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.516162Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.516224Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.516417Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1761971997501
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.517733Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939564:3650] destroyed
2025-11-01T04:39:57.518881Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.519781Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939569:3653], now have 1 active actors on pipe
2025-11-01T04:39:57.519922Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.519950Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.520043Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8c91a546-34c8e9e-53a76b33-ea9e84ec_12 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.520076Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.520093Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.520105Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.520142Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.520181Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.520223Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.520320Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.520696Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939569:3653] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8c91a546-34c8e9e-53a76b33-ea9e84ec_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|8c91a546-34c8e9e-53a76b33-ea9e84ec_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.535964Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.537179Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939572:3654], now have 1 active actors on pipe
2025-11-01T04:39:57.540437Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.540487Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.540952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.541433Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.541474Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.541497Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.541747Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.541784Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.541801Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.547763Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.547824Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.547850Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.547872Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.547972Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-01T04:39:57.548014Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-01T04:39:57.548034Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-01T04:39:57.551283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-01T04:39:57.551347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.552044Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1761971997551
2025-11-01T04:39:57.552969Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.553100Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.558733Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.558789Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.558824Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.558831Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.558851Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.558887Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-01T04:39:57.558909Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.558928Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-01T04:39:57.558949Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.558976Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-01T04:39:57.561855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.561882Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.561891Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.561920Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.561980Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.562158Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1761971997547
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 10
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.563365Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939572:3654] destroyed
2025-11-01T04:39:57.564520Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.565406Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939578:3658], now have 1 active actors on pipe
2025-11-01T04:39:57.565543Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.565571Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.565648Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2b9d0f57-fe6c5fd0-d5785c9f-4b2c1c2d_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.565678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.565698Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.565708Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.565742Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.565776Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.565816Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.565909Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.566289Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939578:3658] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2b9d0f57-fe6c5fd0-d5785c9f-4b2c1c2d_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2b9d0f57-fe6c5fd0-d5785c9f-4b2c1c2d_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.579620Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.580812Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939581:3659], now have 1 active actors on pipe
2025-11-01T04:39:57.584000Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.584043Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.584463Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.584879Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.584918Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.584940Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.585222Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.585273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.585302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.585315Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.585413Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-01T04:39:57.585451Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-01T04:39:57.585479Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-01T04:39:57.590193Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-01T04:39:57.590260Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.590888Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1761971997590
2025-11-01T04:39:57.591786Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.591902Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.596799Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.596861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.596904Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.596904Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.596930Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.596961Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-01T04:39:57.596978Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.596997Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-01T04:39:57.597023Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.597040Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-01T04:39:57.597408Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.597429Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.597442Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.597470Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.597527Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.597688Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1761971997585
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.599068Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939581:3659] destroyed
2025-11-01T04:39:57.600233Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.601118Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939586:3662], now have 1 active actors on pipe
2025-11-01T04:39:57.601294Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.601323Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.601403Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c2a396bd-d17eeb26-a7106576-728e9e34_13 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.601436Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.601451Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.601463Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.601497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.601531Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.601575Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.601667Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.602034Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939586:3662] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c2a396bd-d17eeb26-a7106576-728e9e34_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:57.603130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.603151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.603164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|c2a396bd-d17eeb26-a7106576-728e9e34_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.615943Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.616929Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939589:3663], now have 1 active actors on pipe
2025-11-01T04:39:57.620080Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.620128Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.620563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.620978Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.621019Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.621063Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.621305Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.621359Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.621390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.621402Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.621498Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-01T04:39:57.621537Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-01T04:39:57.621557Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-01T04:39:57.629229Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-01T04:39:57.629291Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.629921Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1761971997629
2025-11-01T04:39:57.630873Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.630979Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.636062Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.636124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.636154Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.636165Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.636184Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.636214Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-01T04:39:57.636233Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.636252Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-01T04:39:57.636274Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.636297Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-01T04:39:57.636660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.636682Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.636694Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.636734Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.636787Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.636930Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1761971997620
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 14
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-01T04:39:57.638174Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939589:3663] destroyed
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.639467Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.640236Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939594:3666], now have 1 active actors on pipe
2025-11-01T04:39:57.640422Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.640450Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.640533Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|c50b2106-7e84ebbd-3a025b0f-e828e32e_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.640566Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.640584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.640596Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.640632Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.640670Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.640718Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.640800Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-01T04:39:57.641206Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939594:3666] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|c50b2106-7e84ebbd-3a025b0f-e828e32e_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
2025-11-01T04:39:57.642052Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.642073Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.642086Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|c50b2106-7e84ebbd-3a025b0f-e828e32e_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.654726Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.655532Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939598:3668], now have 1 active actors on pipe
2025-11-01T04:39:57.658277Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.658320Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.658756Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.659202Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.659243Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.659269Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.659500Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.659555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.659578Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.659592Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.659707Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-01T04:39:57.659745Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-01T04:39:57.659765Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-01T04:39:57.666358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-01T04:39:57.666420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.667029Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1761971997666
2025-11-01T04:39:57.667937Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.668044Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.672544Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.672598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.672628Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.672636Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.672655Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.672684Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-01T04:39:57.672697Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.672715Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-01T04:39:57.672739Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.672762Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-01T04:39:57.673104Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.673129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.673139Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.673167Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.673222Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.673350Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1761971997659
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.674431Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939598:3668] destroyed
2025-11-01T04:39:57.675359Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.676014Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939603:3671], now have 1 active actors on pipe
2025-11-01T04:39:57.676207Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.676235Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.676316Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|432a916f-4a89b60b-abaed49d-49f0a5d5_14 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.676345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.676363Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.676375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.676413Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.676447Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.676483Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.676560Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.676876Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939603:3671] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|432a916f-4a89b60b-abaed49d-49f0a5d5_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|432a916f-4a89b60b-abaed49d-49f0a5d5_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.689459Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.690204Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939606:3672], now have 1 active actors on pipe
2025-11-01T04:39:57.693120Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.693160Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.693596Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.694029Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.694071Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.694100Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.694336Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.694383Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.694412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.694424Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.694518Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-01T04:39:57.694554Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-01T04:39:57.694573Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-01T04:39:57.701592Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-01T04:39:57.701657Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.702278Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1761971997701
2025-11-01T04:39:57.703198Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.703311Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.703492Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037894][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:57.707825Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.707877Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.707919Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.707923Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.707942Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.707970Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-01T04:39:57.707986Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.708004Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-01T04:39:57.708027Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.708051Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-01T04:39:57.708372Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.708394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.708404Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.708431Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.708488Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.708615Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.709558Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939606:3672] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1761971997694
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 13
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.710848Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.711714Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939612:3676], now have 1 active actors on pipe
2025-11-01T04:39:57.711895Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.711924Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.712003Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e4722852-be8c4b39-51a91558-70d17355_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-01T04:39:57.712033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.712053Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.712065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.712100Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.712137Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.712177Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.712282Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.712730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939612:3676] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e4722852-be8c4b39-51a91558-70d17355_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e4722852-be8c4b39-51a91558-70d17355_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.725639Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.726678Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939615:3677], now have 1 active actors on pipe
2025-11-01T04:39:57.730114Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.730160Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.730633Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.731088Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.731131Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.731159Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.731409Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.731461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.731491Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.731503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.731601Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-01T04:39:57.731649Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-01T04:39:57.731672Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-01T04:39:57.741115Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-01T04:39:57.741186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.741794Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1761971997741
2025-11-01T04:39:57.742715Z node 5 :PERSQUEUE DEBUG: partition.cpp:2268: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-11-01T04:39:57.742741Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.742844Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.749005Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7567612100678612901:2362]
2025-11-01T04:39:57.749075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.749106Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.749118Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.749138Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.749174Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-01T04:39:57.749193Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.749215Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-01T04:39:57.749234Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.749255Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-01T04:39:57.749608Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.749632Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.749643Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.749671Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.749729Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.749861Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1761971997731
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 17
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-01T04:39:57.751079Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939615:3677] destroyed
2025-11-01T04:39:57.751951Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.752643Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939622:3680], now have 1 active actors on pipe
2025-11-01T04:39:57.752813Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.752843Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.752925Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a3389eac-21dad341-d9f98454-52895295_15 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-01T04:39:57.752955Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.752970Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.752981Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-01T04:39:57.753016Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.753066Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-01T04:39:57.753108Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.753207Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.753550Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939622:3680] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a3389eac-21dad341-d9f98454-52895295_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|a3389eac-21dad341-d9f98454-52895295_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-01T04:39:57.766300Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.767211Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939629:3682], now have 1 active actors on pipe
2025-11-01T04:39:57.770730Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.770782Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.771249Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-01T04:39:57.771726Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-01T04:39:57.771768Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-01T04:39:57.771796Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-01T04:39:57.776522Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-01T04:39:57.776585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.776611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.776623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2302: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-01T04:39:57.776726Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-01T04:39:57.776768Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-01T04:39:57.776788Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-01T04:39:57.780120Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-01T04:39:57.780190Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.780876Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1761971997780
2025-11-01T04:39:57.781966Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-01T04:39:57.782084Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-01T04:39:57.788465Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7567612100678612992:2368]
2025-11-01T04:39:57.788527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2116: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-01T04:39:57.788555Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-01T04:39:57.788574Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-01T04:39:57.788597Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.788630Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-01T04:39:57.788645Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.788664Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-01T04:39:57.788684Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-01T04:39:57.788706Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-01T04:39:57.789086Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.789110Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.789122Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.789153Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-01T04:39:57.789212Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.789391Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1761971997776
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-01T04:39:57.790642Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939629:3682] destroyed
2025-11-01T04:39:57.791774Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.792577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7567612107103939634:3685], now have 1 active actors on pipe
2025-11-01T04:39:57.792783Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-01T04:39:57.792813Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-01T04:39:57.794174Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-01T04:39:57.794446Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365505 count 9 last offset 0, current partition end offset: 16
2025-11-01T04:39:57.794470Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-01T04:39:57.794515Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365505 accessed 0 times before, last time 2025-11-01T04:39:57.000000Z
2025-11-01T04:39:57.794553Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-01T04:39:57.794598Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-01T04:39:57.794619Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:39:57.796510Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512170 from pos 0 cbcount 2
2025-11-01T04:39:57.801422Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.801709Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.802249Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7567612107103939634:3685] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1761971996273
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
CallPersQueueGRPC request to localhost:15210
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-01T04:39:57.803777Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-01T04:39:57.803835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.803857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.803868Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.804520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7567612107103939637:3686], now have 1 active actors on pipe
2025-11-01T04:39:57.804753Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-01T04:39:57.804782Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-01T04:39:57.805900Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:880: [72075186224037894][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic12' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-01T04:39:57.806106Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1105: [72075186224037894][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365505 count 9 last offset 0, current partition end offset: 16
2025-11-01T04:39:57.806127Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1121: [72075186224037894][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-01T04:39:57.806175Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365505 accessed 0 times before, last time 2025-11-01T04:39:57.000000Z
2025-11-01T04:39:57.806208Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-01T04:39:57.806250Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-01T04:39:57.806270Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:572: FormAnswer for 1 blobs
2025-11-01T04:39:57.807880Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512171 from pos 0 cbcount 2
2025-11-01T04:39:57.808195Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-01T04:39:57.808400Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-01T04:39:57.808866Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7567612107103939637:3686] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1761971996300
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
2025-11-01T04:39:57.842826Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.842861Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.842874Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-01T04:39:57.904254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2289: [72075186224037894][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-11-01T04:39:57.904289Z node 5 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037894][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-11-01T04:39:57.904303Z node 5 :PERSQUEUE DEBUG: partition.cpp:2321: [72075186224037894][Partition][0][StateIdle] Try persist
