2025-11-19T11:44:43.324656Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7574401101314929225:2081];send_to=[0:7307199536658146131:7762515];
2025-11-19T11:44:43.324715Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-19T11:44:43.333960Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-11-19T11:44:43.334216Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-19T11:44:43.341013Z node 5 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[5:7574401100802324152:2079];send_to=[0:7307199536658146131:7762515];
2025-11-19T11:44:43.341810Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-11-19T11:44:43.346526Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/oai3/002d7c/r3tmp/tmpGS4Hls/pdisk_1.dat
2025-11-19T11:44:43.353305Z node 5 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-11-19T11:44:43.393641Z node 4 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-11-19T11:44:43.428559Z node 5 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-19T11:44:43.433434Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-11-19T11:44:43.441561Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-19T11:44:43.441596Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-11-19T11:44:43.444335Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-11-19T11:44:43.444367Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TServer::EnableGrpc on GrpcPort 11286, node 4
2025-11-19T11:44:43.447908Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/oai3/002d7c/r3tmp/yandexEmKy1J.tmp
2025-11-19T11:44:43.447922Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/oai3/002d7c/r3tmp/yandexEmKy1J.tmp
2025-11-19T11:44:43.448001Z node 4 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/oai3/002d7c/r3tmp/yandexEmKy1J.tmp
2025-11-19T11:44:43.448065Z node 4 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-11-19T11:44:43.450835Z node 4 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 5 Cookie 5
2025-11-19T11:44:43.450899Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-19T11:44:43.453614Z node 4 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(5, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-11-19T11:44:43.458008Z INFO: TTestServer started on Port 3968 GrpcPort 11286
TClient is connected to server localhost:3968
PQClient connected to localhost:11286
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-11-19T11:44:43.494419Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-11-19T11:44:43.534667Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
2025-11-19T11:44:43.613133Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720660, at schemeshard: 72057594046644480
waiting...
2025-11-19T11:44:43.875157Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7574401101314930189:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-19T11:44:43.875195Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-19T11:44:43.875452Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7574401101314930225:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-19T11:44:43.875475Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7574401101314930226:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-19T11:44:43.875515Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-11-19T11:44:43.876584Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720662:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-11-19T11:44:43.885139Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7574401101314930229:2331], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720662 completed, doublechecking }
2025-11-19T11:44:43.886660Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-19T11:44:43.911344Z node 5 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:615: Compilation failed, self: [5:7574401100802324527:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-19T11:44:43.912285Z node 5 :KQP_SESSION WARN: kqp_session_actor.cpp:2517: SessionId: ydb://session/3?node_id=5&id=NjM4NzA1YzEtZjU0MDJhNjgtNDljYWM1OGMtMzQ4MzEwYTY=, ActorId: [5:7574401100802324494:2298], ActorState: ExecuteState, TraceId: 01kadywsvwd7c97f9xa3d8zp78, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-19T11:44:43.912512Z node 5 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-11-19T11:44:43.920174Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-19T11:44:43.966662Z node 4 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-11-19T11:44:43.969163Z node 4 :TX_PROXY ERROR: schemereq.cpp:593: Actor# [4:7574401101314930580:2917] txid# 281474976720666, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 9], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-11-19T11:44:43.977631Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:615: Compilation failed, self: [4:7574401101314930603:2360], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-11-19T11:44:43.978885Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2517: SessionId: ydb://session/3?node_id=4&id=NDc4OThmZmUtNDczN2RiMjUtZjYwYTE4NmMtZGQ0NTM4YzU=, ActorId: [4:7574401101314930185:2322], ActorState: ExecuteState, TraceId: 01kadywsv12tnmrcrnhn2e3dnc, ReplyQueryCompileError, status: SCHEME_ERROR, issues: { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } }, remove tx with tx_id: 
2025-11-19T11:44:43.979062Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-11-19T11:44:44.023110Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720667. Ctx: { TraceId: 01kadywsyy87vtr5rfkqwwpjts, Database: , SessionId: ydb://session/3?node_id=4&id=YzJhMThiM2ItOTUxMjA3Y2QtZTgwOGUxN2YtNWJkZjI4MTQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [4:7574401105609898058:3050] 
2025-11-19T11:44:44.327552Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-19T11:44:44.345214Z node 5 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-11-19T11:44:48.324997Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7574401101314929225:2081];send_to=[0:7307199536658146131:7762515];
2025-11-19T11:44:48.325083Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-11-19T11:44:48.344307Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[5:7574401100802324152:2079];send_to=[0:7307199536658146131:7762515];
2025-11-19T11:44:48.344358Z node 5 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:11286
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-19T11:44:49.343890Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11286
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720673
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-11-19T11:44:49.377776Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037893][] pipe [4:7574401127084734992:3299] connected; active server actors: 1
2025-11-19T11:44:49.377869Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1520: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-19T11:44:49.378507Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-11-19T11:44:49.383300Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720674. Ctx: { TraceId: 01kadywz6n5jkqq1dg0dfapd0b, Database: , SessionId: ydb://session/3?node_id=4&id=ZjVlNDM4MGYtYzNlYmMyYTMtZjlmNGI3OGMtNjg5MzhlYmM=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-19T11:44:49.384994Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-11-19T11:44:49.386276Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-11-19T11:44:49.389706Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-19T11:44:49.389827Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-11-19T11:44:49.389849Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-19T11:44:49.389870Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-11-19T11:44:49.390082Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401127084735014:2459], now have 1 active actors on pipe
2025-11-19T11:44:49.390100Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401127084734988:3298], now have 1 active actors on pipe
2025-11-19T11:44:49.390191Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 5, Generation 1
2025-11-19T11:44:49.390366Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.393239Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
2025-11-19T11:44:49.398066Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401127084735072:3355], now have 1 active actors on pipe
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--topic1 version0
2025-11-19T11:44:49.398329Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.401898Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.402109Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-11-19T11:44:49.402123Z node 5 :PERSQUEUE DEBUG: partition.cpp:1315: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-19T11:44:49.402194Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-19T11:44:49.402235Z node 5 :PERSQUEUE INFO: partition_init.cpp:1107: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [5:7574401126572128582:2358]
2025-11-19T11:44:49.403079Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-11-19T11:44:49.403084Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-11-19T11:44:49.403091Z node 5 :PERSQUEUE INFO: partition.cpp:707: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [5:7574401126572128582:2358]
2025-11-19T11:44:49.403098Z node 5 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-19T11:44:49.403108Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-19T11:44:49.403429Z node 5 :PERSQUEUE DEBUG: partition.cpp:4405: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-11-19T11:44:49.403436Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.403441Z node 5 :PERSQUEUE DEBUG: partition.cpp:2399: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-19T11:44:49.403456Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.403458Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.403461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.403463Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.403471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.403472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.403474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.403476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.403480Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.403490Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-19T11:44:49.403499Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037892][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-19T11:44:49.403614Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.403645Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:49.405467Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.405522Z node 5 :PERSQUEUE DEBUG: partition.cpp:1427: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1763552689444, TxId 281474976720673
2025-11-19T11:44:49.405550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.405555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.405557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.405567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2463: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-19T11:44:49.405583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:49.405586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:49.405588Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.405641Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:49.406770Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:49.407090Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037892][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-19T11:44:49.407141Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:49.407150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.407153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.407156Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.407159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.407161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.407169Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:49.407304Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-19T11:44:49.407357Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-19T11:44:49.407434Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.412851Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.412898Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.414788Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.503605Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.503622Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.503626Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.503630Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.503636Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.604899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.604922Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.604926Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.604931Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.604934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.709123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.709150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.709153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.709157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.709160Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.815512Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.815535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.815539Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.815543Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.815547Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720673
    CreateStep: 1763552689444
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 600000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720673
    CreateStep: 1763552689444
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:11286
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-11-19T11:44:49.913728Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
PQ Client: create topic: rt3.dc1--topic12 with 1 partitions
CallPersQueueGRPC request to localhost:11286
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-19T11:44:49.917121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.917143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.917146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.917151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.917154Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.922486Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic12, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11286
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic12"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720675
  SchemeShardTabletId: 72057594046644480
  PathId: 14
}
ErrorCode: OK
AddTopic: rt3.dc1--topic12
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic12, dc = dc1
2025-11-19T11:44:49.971333Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2960: [PQ: 72075186224037894] Handle TEvInterconnect::TEvNodeInfo
2025-11-19T11:44:49.973048Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2992: [PQ: 72075186224037894] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-11-19T11:44:49.973150Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037894] no config, start with empty partitions and default config
2025-11-19T11:44:49.973162Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-19T11:44:49.973179Z node 5 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037894] doesn't have tx writes info
2025-11-19T11:44:49.973508Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401127084735189:3441], now have 1 active actors on pipe
2025-11-19T11:44:49.973953Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.979852Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1656: [72075186224037895][] pipe [4:7574401127084735190:3442] connected; active server actors: 1
2025-11-19T11:44:49.979948Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1520: [72075186224037895][rt3.dc1--topic12] updating configuration. Deleted partitions []. Added partitions [0]
2025-11-19T11:44:49.980334Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:971: [72075186224037895][rt3.dc1--topic12] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037895
2025-11-19T11:44:49.981629Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:140: [72075186224037895][rt3.dc1--topic12] BALANCER INIT DONE for rt3.dc1--topic12: (0, 72075186224037894) 
2025-11-19T11:44:49.983865Z node 4 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720676. Ctx: { TraceId: 01kadywzrvcmqrkt8wa9d2111b, Database: , SessionId: ydb://session/3?node_id=4&id=YTc2ZjlhMzctNWU4ZTNhZWEtYjI1MDBkNTgtNDJjMjc1N2M=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-11-19T11:44:49.984902Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:404: [72075186224037895][rt3.dc1--topic12] TEvClientConnected TabletId 72075186224037894, NodeId 5, Generation 1
2025-11-19T11:44:49.984844Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401127084735213:2478], now have 1 active actors on pipe
2025-11-19T11:44:49.984932Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.989130Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401127084735243:3478], now have 1 active actors on pipe
2025-11-19T11:44:49.989260Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.990274Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.990668Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitConfigStep
2025-11-19T11:44:49.990696Z node 5 :PERSQUEUE DEBUG: partition.cpp:1315: [72075186224037894][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-11-19T11:44:49.990791Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-11-19T11:44:49.990843Z node 5 :PERSQUEUE INFO: partition_init.cpp:1107: [72075186224037894][Partition][0][StateInit] bootstrapping 0 [5:7574401126572128648:2361]
2025-11-19T11:44:49.991648Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic12:0:Initializer] Start initializing step TInitFieldsStep
2025-11-19T11:44:49.991652Z node 5 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic12:0:Initializer] Initializing completed.
2025-11-19T11:44:49.991658Z node 5 :PERSQUEUE INFO: partition.cpp:707: [72075186224037894][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic12' partition 0 generation 1 [5:7574401126572128648:2361]
2025-11-19T11:44:49.991667Z node 5 :PERSQUEUE DEBUG: partition.cpp:727: [72075186224037894][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic12 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-11-19T11:44:49.991675Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037894][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-19T11:44:49.992030Z node 5 :PERSQUEUE DEBUG: partition.cpp:4405: [72075186224037894][Partition][0][StateIdle] Process pending events. Count 1
2025-11-19T11:44:49.992038Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.992043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2399: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TTransaction[ProposeConfig])
2025-11-19T11:44:49.992058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.992061Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.992064Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.992066Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.992079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.992081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.992083Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.992085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.992087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.992096Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-19T11:44:49.992105Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:70: [72075186224037894][Partition][0][StateIdle] Process MLP pending events. Count 0
2025-11-19T11:44:49.992207Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.992242Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic12
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--topic12 version0
2025-11-19T11:44:49.994027Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.994080Z node 5 :PERSQUEUE DEBUG: partition.cpp:1427: [72075186224037894][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1763552690032, TxId 281474976720675
2025-11-19T11:44:49.994102Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.994107Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:49.994109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.994119Z node 5 :PERSQUEUE DEBUG: partition.cpp:2463: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TTransaction[ProposeConfig])
2025-11-19T11:44:49.994134Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:49.994136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:49.994152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.994205Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:49.995405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:49.995460Z node 5 :PERSQUEUE DEBUG: partition_mlp.cpp:107: [72075186224037894][Partition][0][StateIdle] Initializing MLP Consumers: 0
2025-11-19T11:44:49.995510Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:49.995526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:49.995530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.995533Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:49.995536Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:49.995538Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:49.995547Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:49.995702Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037894] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 6291456 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic12" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic12" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-11-19T11:44:49.995732Z node 5 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037894] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-11-19T11:44:49.995809Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:49.998066Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:49.998115Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:3570: [PQ: 72075186224037894] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-11-19T11:44:50.002018Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037894] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-11-19T11:44:50.017132Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.017152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.017155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.017159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.017162Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.094956Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.094981Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.094988Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.094992Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.094995Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.117530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.117554Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.117557Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.117561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.117564Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.195353Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.195373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.195377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.195382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.195384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.217806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.217828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.217830Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.217839Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.217842Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.299638Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.299661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.299663Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.299668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.299670Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.318444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.318467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.318469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.318472Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.318475Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.401084Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.401109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.401111Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.401115Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.401118Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.418562Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.418598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.418602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.418606Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.418610Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--topic12
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 14
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720675
    CreateStep: 1763552690032
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 14
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic12"
    PathId: 14
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720675
    CreateStep: 1763552690032
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic12"
    PathId: 14
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 6291456
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037894
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037895
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 13
    PathsLimit: 10000
    ShardsInside: 8
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 2
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic12"
 name rt3.dc1--topic12 version1
CallPersQueueGRPC request to localhost:11286
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic12"
  }
}
2025-11-19T11:44:50.497775Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic12"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 6291456
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic12"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.498985Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.501090Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.501113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.501117Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.501126Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.501129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.504760Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702644:3539], now have 1 active actors on pipe
2025-11-19T11:44:50.504812Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.504822Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.504855Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2d6714a1-748527e6-dffd537f-ccd646f4_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.504869Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.504873Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.504880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.504883Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.504890Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.504901Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.504904Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.504908Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.504926Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.504950Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.505182Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-19T11:44:50.505640Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702644:3539] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2d6714a1-748527e6-dffd537f-ccd646f4_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2d6714a1-748527e6-dffd537f-ccd646f4_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
  }
  MessageNo: 0
}
2025-11-19T11:44:50.506531Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.507118Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702647:3540], now have 1 active actors on pipe
2025-11-19T11:44:50.507341Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.507355Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.507495Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-19T11:44:50.507512Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.507531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.507535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.507548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.507550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.507556Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.507591Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-19T11:44:50.507659Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-19T11:44:50.507672Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.507675Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.507678Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.507741Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1763552690507
2025-11-19T11:44:50.507776Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.507798Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-19T11:44:50.509531Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.509552Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.509654Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-19T11:44:50.510147Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-11-19T11:44:50.510179Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.510190Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.510203Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-19T11:44:50.510244Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-19T11:44:50.510250Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:972: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-19T11:44:50.510254Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.510257Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.510259Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.510261Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.510263Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.510274Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.510288Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.510333Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-19T11:44:50.510350Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-19T11:44:50.510354Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-19T11:44:50.510364Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.510376Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-19T11:44:50.510391Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-19T11:44:50.510406Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-19T11:44:50.510419Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-19T11:44:50.510427Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1022: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1763552690507 queuesize 0 startOffset 0
2025-11-19T11:44:50.510505Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-19T11:44:50.510985Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702647:3540] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1763552690507
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 2
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.511758Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.512286Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702651:3542], now have 1 active actors on pipe
2025-11-19T11:44:50.512391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.512405Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.512440Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|32b3ca79-8424b792-650d5de5-6b24de2_0 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.512458Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.512467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.512474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.512476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.512481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.512493Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.512496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.512500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.512519Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.512556Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.512636Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-19T11:44:50.512899Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702651:3542] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|32b3ca79-8424b792-650d5de5-6b24de2_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|32b3ca79-8424b792-650d5de5-6b24de2_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
  }
  MessageNo: 0
}
2025-11-19T11:44:50.514020Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.514461Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702654:3543], now have 1 active actors on pipe
2025-11-19T11:44:50.514563Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.514577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.514725Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size 128 offset: -1
2025-11-19T11:44:50.514744Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.514758Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.514761Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.514773Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.514781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.514787Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.514821Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-19T11:44:50.514874Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-19T11:44:50.514887Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.514890Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.514893Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.514950Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 186 WTime 1763552690514
2025-11-19T11:44:50.514982Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.514995Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 186
2025-11-19T11:44:50.516405Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 186 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.516448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.516469Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-19T11:44:50.516475Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 135 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.516495Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.516512Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
2025-11-19T11:44:50.516566Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:930: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-11-19T11:44:50.516578Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:972: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-11-19T11:44:50.516582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.516585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.516586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.516589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.516591Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.516601Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.516614Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.516675Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037894][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic12' partition 0 user user offset 0 partno 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-11-19T11:44:50.516699Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037894][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 186 count 1 last offset 0, current partition end offset: 1
2025-11-19T11:44:50.516703Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037894][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-11-19T11:44:50.516714Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.516725Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-11-19T11:44:50.516741Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-19T11:44:50.516751Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-19T11:44:50.516770Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 1 count 1 size 166 from pos 0 cbcount 1
2025-11-19T11:44:50.516794Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1022: Topic 'rt3.dc1--topic12' partition 0 user user readTimeStamp done, result 1763552690514 queuesize 0 startOffset 0
2025-11-19T11:44:50.516749Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.517142Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702654:3543] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    WriteTimestampMS: 1763552690514
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 0
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.519513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.519524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.519526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.519528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.519531Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.519660Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.520200Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702658:3545], now have 1 active actors on pipe
2025-11-19T11:44:50.520296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.520315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.520358Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5c9916a4-e8492812-13c7f8d5-f7525f57_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.520368Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.520373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.520379Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.520381Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.520385Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.520399Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.520402Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.520406Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.520425Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.520443Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.520543Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.521354Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702658:3545] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5c9916a4-e8492812-13c7f8d5-f7525f57_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5c9916a4-e8492812-13c7f8d5-f7525f57_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.537221Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.538158Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702662:3547], now have 1 active actors on pipe
2025-11-19T11:44:50.540315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.540348Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.540441Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.540954Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.540974Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.540979Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.541045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.541072Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.541077Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.541089Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.541092Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.541097Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.541099Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.541106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.541149Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-19T11:44:50.541167Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.541171Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-19T11:44:50.541175Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.541178Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-19T11:44:50.541674Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-19T11:44:50.541689Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.541692Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.541696Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.541790Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1763552690540
2025-11-19T11:44:50.542173Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.542187Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.548800Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.548837Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.548868Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.548874Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.548883Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.548897Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-19T11:44:50.548906Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.548913Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-19T11:44:50.548919Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.548923Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-19T11:44:50.548984Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.548995Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.548998Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.549000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.549003Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.549029Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.549056Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.551114Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1763552690540
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.552351Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702662:3547] destroyed
2025-11-19T11:44:50.552772Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.553324Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702668:3550], now have 1 active actors on pipe
2025-11-19T11:44:50.553515Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.553528Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.553570Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ea796a26-4f8d5aac-75f0d6c9-a012b4af_1 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.553583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.553588Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.553595Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.553597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.553603Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.553617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.553620Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.553624Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.553643Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.553665Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.553844Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ea796a26-4f8d5aac-75f0d6c9-a012b4af_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|ea796a26-4f8d5aac-75f0d6c9-a012b4af_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.558137Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702668:3550] destroyed
2025-11-19T11:44:50.563034Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.564209Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702671:3551], now have 1 active actors on pipe
2025-11-19T11:44:50.566391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.566415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.566507Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.566971Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.566981Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.566987Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.567018Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.567042Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.567046Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.567057Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.567061Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.567066Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.567069Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.567079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.567121Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-19T11:44:50.567136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.567139Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-19T11:44:50.567143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.567146Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-19T11:44:50.567430Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-11-19T11:44:50.567444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.567448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.567452Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.567525Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1763552690567
2025-11-19T11:44:50.568527Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.568542Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.572965Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.572990Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.573042Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.573051Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.573066Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-11-19T11:44:50.573070Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.573075Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-11-19T11:44:50.573082Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.573088Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-11-19T11:44:50.573146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.573150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.573152Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.573155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.573157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.573170Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.573193Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.573454Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1763552690566
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 1
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.573372Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.574144Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702671:3551] destroyed
2025-11-19T11:44:50.574924Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.575762Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702676:3554], now have 1 active actors on pipe
2025-11-19T11:44:50.575782Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.575791Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.575830Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|7fa9ae6a-e3ed7b1c-b9c29cbe-e5d12236_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.575843Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.575848Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.575855Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.575857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.575862Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.575875Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.575880Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.575883Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.575904Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.575922Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.576123Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|7fa9ae6a-e3ed7b1c-b9c29cbe-e5d12236_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.576546Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702676:3554] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|7fa9ae6a-e3ed7b1c-b9c29cbe-e5d12236_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.587032Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.588754Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702679:3555], now have 1 active actors on pipe
2025-11-19T11:44:50.589159Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.589171Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.589382Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.589852Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.589863Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.589869Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.589901Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.589927Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.589932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.589944Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.589947Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.589952Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.589957Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.589963Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.590004Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-19T11:44:50.590021Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.590028Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-19T11:44:50.590032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.590035Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-19T11:44:50.590308Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-19T11:44:50.590319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.590323Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.590326Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.590402Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1763552690589
2025-11-19T11:44:50.590576Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.590591Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.596224Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.596253Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.596287Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.596295Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.596308Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-19T11:44:50.596311Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.596317Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-19T11:44:50.596326Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.596331Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-19T11:44:50.596378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.596382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.596384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.596387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.596390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.596403Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.596425Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.596670Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.596585Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.597617Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702679:3555] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1763552690589
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 3
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.601838Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.602810Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.602828Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.602831Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.602835Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.602838Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.603296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702684:3558], now have 1 active actors on pipe
2025-11-19T11:44:50.603445Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.603458Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.603506Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|15a7c0c1-c54f2278-490030e7-e3129daa_2 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.603515Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.603519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.603525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.603528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.603532Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.603545Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.603548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.603550Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.603568Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.603590Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.604028Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|15a7c0c1-c54f2278-490030e7-e3129daa_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|15a7c0c1-c54f2278-490030e7-e3129daa_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.608754Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702684:3558] destroyed
2025-11-19T11:44:50.615671Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.616437Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702688:3560], now have 1 active actors on pipe
2025-11-19T11:44:50.617805Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.617823Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.617921Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.618391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.618402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.618408Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.618441Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.618461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.618465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.618474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.618476Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.618479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.618481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.618486Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.618518Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-19T11:44:50.618532Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.618535Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-19T11:44:50.618537Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.618539Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-19T11:44:50.619036Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-11-19T11:44:50.619048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.619051Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.619055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.619127Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1763552690618
2025-11-19T11:44:50.619519Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.619532Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.619733Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.619736Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.619738Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.619740Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.619743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.623098Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.623128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.623161Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.623172Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.623182Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.623186Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-11-19T11:44:50.623189Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.623194Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-11-19T11:44:50.623201Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.623204Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-11-19T11:44:50.623244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.623273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.623275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.623278Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.623280Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.623292Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.623315Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.623435Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1763552690618
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.624379Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702688:3560] destroyed
2025-11-19T11:44:50.624653Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.625085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702693:3563], now have 1 active actors on pipe
2025-11-19T11:44:50.625296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.625317Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.625363Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|94504cf9-3cefa138-e8adf42-6e650efe_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.625377Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.625381Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.625387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.625391Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.625396Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.625415Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.625418Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.625420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.625439Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.625456Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.625531Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|94504cf9-3cefa138-e8adf42-6e650efe_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|94504cf9-3cefa138-e8adf42-6e650efe_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.625885Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702693:3563] destroyed
2025-11-19T11:44:50.632263Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.632707Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702696:3564], now have 1 active actors on pipe
2025-11-19T11:44:50.633860Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.633884Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.634002Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.634071Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.634085Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.634096Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.634118Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.634143Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.634151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.634164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.634166Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.634171Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.634173Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.634180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.634223Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-19T11:44:50.634253Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.634263Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-19T11:44:50.634268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.634275Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-19T11:44:50.634502Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-19T11:44:50.634521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.634524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.634527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.634601Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1763552690633
2025-11-19T11:44:50.634810Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.634831Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.637874Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.637902Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.637923Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.637934Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.637941Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.637954Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-19T11:44:50.637963Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.637968Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-19T11:44:50.637975Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.637984Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-19T11:44:50.638022Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.638030Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.638032Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.638035Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.638037Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.638048Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.638073Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.638152Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1763552690633
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-19T11:44:50.638609Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702696:3564] destroyed
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.639343Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.639812Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702701:3567], now have 1 active actors on pipe
2025-11-19T11:44:50.639945Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.639956Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.640000Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|271fedf5-f49505ef-cc894bc2-3d489ee_3 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.640010Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.640014Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.640020Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.640023Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.640028Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.640040Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.640043Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.640047Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.640064Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.640082Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.640149Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|271fedf5-f49505ef-cc894bc2-3d489ee_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.640481Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702701:3567] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|271fedf5-f49505ef-cc894bc2-3d489ee_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.647091Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.648133Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702704:3568], now have 1 active actors on pipe
2025-11-19T11:44:50.649183Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.649197Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.649267Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.649309Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.649316Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.649320Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.649342Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.649362Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.649366Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.649378Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.649382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.649386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.649388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.649394Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.649431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-19T11:44:50.649442Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.649445Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-19T11:44:50.649450Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.649453Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-19T11:44:50.650000Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-11-19T11:44:50.650009Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.650012Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.650014Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.650065Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1763552690649
2025-11-19T11:44:50.650246Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.650256Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.653342Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.653373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.653384Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.653405Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.653411Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.653425Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-11-19T11:44:50.653428Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.653432Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-11-19T11:44:50.653438Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.653442Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-11-19T11:44:50.653486Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.653491Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.653493Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.653496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.653498Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.653509Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.653530Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1763552690649
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.653607Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.654520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702704:3568] destroyed
2025-11-19T11:44:50.654830Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.655285Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702709:3571], now have 1 active actors on pipe
2025-11-19T11:44:50.655444Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.655454Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.655493Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|20d250eb-943c288d-4ec3279c-19e4898f_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.655505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.655508Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.655515Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.655517Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.655521Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.655535Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.655538Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.655541Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.655559Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.655577Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.655636Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|20d250eb-943c288d-4ec3279c-19e4898f_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|20d250eb-943c288d-4ec3279c-19e4898f_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.660262Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702709:3571] destroyed
2025-11-19T11:44:50.663845Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.668033Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702713:3573], now have 1 active actors on pipe
2025-11-19T11:44:50.669519Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.669538Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.669641Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.669699Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.669707Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.669712Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.669746Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.669770Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.669775Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.669788Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.669790Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.669795Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.669798Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.669804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.669844Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-19T11:44:50.669862Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.669869Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-19T11:44:50.669874Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.669876Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-19T11:44:50.670109Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-19T11:44:50.670121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.670124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.670128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.670205Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1763552690668
2025-11-19T11:44:50.670403Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.670418Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.680996Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.680664Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.680707Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.680735Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.680747Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.680755Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.680770Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-19T11:44:50.680774Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.680779Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-19T11:44:50.680787Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.680792Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-19T11:44:50.680853Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.680857Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.680860Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.680862Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.680865Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.680878Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.680900Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.681637Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702713:3573] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1763552690668
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 11
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.684634Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.685321Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702718:3576], now have 1 active actors on pipe
2025-11-19T11:44:50.685394Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.685407Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.685466Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b88b0d69-482fd89-fbaefe2e-f9e0511e_4 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.685484Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.685489Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.685497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.685499Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.685504Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.685518Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.685525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.685530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.685552Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.685583Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.685712Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b88b0d69-482fd89-fbaefe2e-f9e0511e_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|b88b0d69-482fd89-fbaefe2e-f9e0511e_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.686025Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702718:3576] destroyed
2025-11-19T11:44:50.694084Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.694918Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702722:3578], now have 1 active actors on pipe
2025-11-19T11:44:50.696101Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.696127Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.696228Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.696285Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.696301Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.696307Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.696336Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.696363Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.696372Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.696386Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.696393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.696398Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.696400Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.696407Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.696449Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-19T11:44:50.696470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.696476Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-19T11:44:50.696481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.696483Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-19T11:44:50.696698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-11-19T11:44:50.696716Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.696719Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.696723Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.696791Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1763552690695
2025-11-19T11:44:50.696983Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.697005Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.700951Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.700979Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.701014Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.701038Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.701052Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-11-19T11:44:50.701056Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.701061Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-11-19T11:44:50.701068Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.701074Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-11-19T11:44:50.701126Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.701130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.701131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.701134Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.701136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.701159Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.701182Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.701300Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
2025-11-19T11:44:50.701406Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1763552690695
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.702168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.702186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.702188Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.702190Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.702193Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.702212Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702722:3578] destroyed
2025-11-19T11:44:50.702563Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.703157Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702727:3581], now have 1 active actors on pipe
2025-11-19T11:44:50.703174Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.703180Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.703224Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f34cbaa7-f105d054-c2cf21a1-bf75f69_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.703234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.703237Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.703242Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.703244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.703248Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.703268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.703271Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.703275Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.703291Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.703305Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.703362Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f34cbaa7-f105d054-c2cf21a1-bf75f69_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.705446Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702727:3581] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f34cbaa7-f105d054-c2cf21a1-bf75f69_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.711766Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.712535Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702730:3582], now have 1 active actors on pipe
2025-11-19T11:44:50.713838Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.713858Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.713940Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.713987Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.713996Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.714000Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.714022Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.714044Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.714048Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.714057Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.714058Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.714062Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.714063Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.714068Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.714114Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-19T11:44:50.714128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.714133Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-19T11:44:50.714136Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.714138Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-19T11:44:50.714360Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-19T11:44:50.714367Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.714369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.714371Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.714431Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1763552690712
2025-11-19T11:44:50.714613Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.714624Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.719265Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.719298Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.719319Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.719333Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.719340Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.719354Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-19T11:44:50.719358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.719372Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-19T11:44:50.719379Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.719384Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-19T11:44:50.719427Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.719431Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.719434Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.719436Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.719438Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.719451Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.719472Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.719580Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.720102Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702730:3582] destroyed
2025-11-19T11:44:50.720121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.720123Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.720127Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.720128Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.720130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1763552690712
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.721046Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.721676Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702735:3585], now have 1 active actors on pipe
2025-11-19T11:44:50.721907Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.721924Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.721959Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|58d844d0-1bd70414-daf02023-fc22ede5_5 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.721968Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.721972Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.721977Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.721979Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.721984Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.721996Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.722000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.722004Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.722027Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.722045Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.722263Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|58d844d0-1bd70414-daf02023-fc22ede5_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.722763Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702735:3585] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|58d844d0-1bd70414-daf02023-fc22ede5_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.730863Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.731568Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702738:3586], now have 1 active actors on pipe
2025-11-19T11:44:50.733041Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.733064Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.733157Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.733226Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.733234Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.733238Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.733259Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.733283Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.733288Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.733298Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.733302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.733306Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.733309Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.733315Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.733358Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-19T11:44:50.733375Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.733379Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-19T11:44:50.733384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.733388Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-19T11:44:50.733624Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-11-19T11:44:50.733634Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.733638Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.733640Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.733693Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1763552690733
2025-11-19T11:44:50.733889Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.733902Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.737915Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.737935Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.737968Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.737977Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.737990Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-11-19T11:44:50.737992Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.737995Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-11-19T11:44:50.738001Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.738013Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-11-19T11:44:50.738057Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.738061Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.738063Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.738066Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.738075Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.738082Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.738102Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.738357Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.738273Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1763552690733
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-19T11:44:50.738830Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702738:3586] destroyed
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.739509Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.739996Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702743:3589], now have 1 active actors on pipe
2025-11-19T11:44:50.740084Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.740093Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.740141Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d2c9f830-e445ceac-76984efc-ccbbb9da_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.740151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.740155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.740161Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.740163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.740168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.740179Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.740182Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.740186Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.740211Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.740227Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.740259Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.740781Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702743:3589] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d2c9f830-e445ceac-76984efc-ccbbb9da_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d2c9f830-e445ceac-76984efc-ccbbb9da_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.750320Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.751218Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702746:3590], now have 1 active actors on pipe
2025-11-19T11:44:50.752547Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.752574Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.752678Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.752737Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.752747Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.752763Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.752791Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.752816Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.752822Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.752833Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.752836Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.752842Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.752845Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.752851Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.752891Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-19T11:44:50.752908Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.752914Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-19T11:44:50.752919Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.752923Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-19T11:44:50.753187Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-19T11:44:50.753200Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.753203Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.753207Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.753288Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1763552690752
2025-11-19T11:44:50.753594Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.753609Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.758485Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.758513Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.758548Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.758557Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.758572Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-19T11:44:50.758576Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.758581Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-19T11:44:50.758588Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.758592Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-19T11:44:50.758657Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.758661Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.758666Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.758668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.758671Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.758683Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.758708Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.758866Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.758958Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.759454Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702746:3590] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1763552690752
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.760411Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.761130Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702751:3593], now have 1 active actors on pipe
2025-11-19T11:44:50.761322Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.761333Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.761370Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6ebecfb9-74431059-1cc5eca9-881f3bd7_6 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.761379Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.761382Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.761388Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.761390Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.761395Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.761408Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.761411Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.761414Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.761428Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.761448Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.761625Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6ebecfb9-74431059-1cc5eca9-881f3bd7_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.762314Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702751:3593] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6ebecfb9-74431059-1cc5eca9-881f3bd7_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.771598Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.772841Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702754:3594], now have 1 active actors on pipe
2025-11-19T11:44:50.773715Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.773734Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.773818Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.773901Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.773910Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.773916Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.773940Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.773964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.773969Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.773982Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.773985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.773991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.773993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.773999Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.774040Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-19T11:44:50.774054Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.774058Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-19T11:44:50.774064Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.774067Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-19T11:44:50.774327Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-11-19T11:44:50.774337Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.774341Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.774344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.774424Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1763552690774
2025-11-19T11:44:50.774629Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.774663Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.779006Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.779033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.779063Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.779071Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.779085Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-11-19T11:44:50.779089Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.779093Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-11-19T11:44:50.779101Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.779105Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-11-19T11:44:50.779146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.779151Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.779153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.779155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.779158Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.779171Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.779191Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.779337Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.779429Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1763552690773
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.780946Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.781524Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702754:3594] destroyed
2025-11-19T11:44:50.781547Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702759:3597], now have 1 active actors on pipe
2025-11-19T11:44:50.781746Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.781755Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.781792Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5d7de1c4-5f3c5de5-9ea13d1d-de03d72a_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.781806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.781810Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.781817Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.781819Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.781826Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.781839Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.781842Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.781845Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.781866Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.781885Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.782080Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5d7de1c4-5f3c5de5-9ea13d1d-de03d72a_7"
    Status: Active
    SeqNo: 0
  }
}
2025-11-19T11:44:50.782663Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702759:3597] destroyed
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5d7de1c4-5f3c5de5-9ea13d1d-de03d72a_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.791667Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.793552Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702763:3599], now have 1 active actors on pipe
2025-11-19T11:44:50.793925Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.793936Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.794019Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.794081Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.794091Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.794097Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.794121Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.794144Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.794149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.794160Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.794164Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.794169Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.794174Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.794180Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.794219Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-19T11:44:50.794234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.794240Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-19T11:44:50.794244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.794247Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-19T11:44:50.794879Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-19T11:44:50.794892Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.794895Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.794899Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.794988Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1763552690794
2025-11-19T11:44:50.795187Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.795204Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.799519Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.799546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.799576Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.799583Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.799596Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-19T11:44:50.799599Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.799604Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-19T11:44:50.799611Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.799616Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-19T11:44:50.799656Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.799660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.799662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.799665Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.799667Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.799680Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.799701Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.799912Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1763552690793
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.799838Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.801158Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702763:3599] destroyed
2025-11-19T11:44:50.802409Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.802911Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.802921Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.802924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.802926Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.802929Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.803237Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702768:3602], now have 1 active actors on pipe
2025-11-19T11:44:50.803438Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.803448Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.803485Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8ddc49f1-5c8b934a-fd6d5c55-f8f61407_7 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.803496Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.803500Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.803505Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.803507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.803512Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.803524Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.803527Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.803530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.803543Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.803560Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.803722Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8ddc49f1-5c8b934a-fd6d5c55-f8f61407_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|8ddc49f1-5c8b934a-fd6d5c55-f8f61407_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.812933Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.813262Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702768:3602] destroyed
2025-11-19T11:44:50.813927Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702771:3603], now have 1 active actors on pipe
2025-11-19T11:44:50.815864Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.815891Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.815988Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.816049Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.816059Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.816066Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.816097Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.816120Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.816125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.816137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.816141Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.816146Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.816149Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.816155Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.816197Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-19T11:44:50.816211Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.816216Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-19T11:44:50.816220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.816224Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-19T11:44:50.816455Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-11-19T11:44:50.816465Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.816469Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.816473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.816545Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1763552690813
2025-11-19T11:44:50.816739Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.816753Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.820937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.820949Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.820951Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.820954Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.820957Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.821082Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.821102Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.821132Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.821138Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.821152Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-11-19T11:44:50.821155Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.821160Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-11-19T11:44:50.821168Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.821174Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
2025-11-19T11:44:50.822433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.822439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.822441Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.822445Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.822447Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.822461Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.822498Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.822859Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.822975Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.823739Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702771:3603] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1763552690813
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.824640Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.825491Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702776:3606], now have 1 active actors on pipe
2025-11-19T11:44:50.825522Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.825530Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.825570Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|76f121c0-75620784-d51d261d-15f61f6c_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.825584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.825589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.825595Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.825597Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.825602Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.825615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.825618Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.825621Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.825639Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.825659Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.825821Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.826570Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702776:3606] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|76f121c0-75620784-d51d261d-15f61f6c_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|76f121c0-75620784-d51d261d-15f61f6c_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.834962Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.835731Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702780:3608], now have 1 active actors on pipe
2025-11-19T11:44:50.837195Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.837220Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.837320Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.837377Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.837387Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.837393Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.837420Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.837462Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.837467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.837479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.837481Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.837485Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.837488Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.837494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.837537Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-19T11:44:50.837554Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.837559Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-19T11:44:50.837565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.837569Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-19T11:44:50.837797Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-19T11:44:50.837809Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.837812Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.837815Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.837895Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1763552690836
2025-11-19T11:44:50.838084Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.838098Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.842573Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.842598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.842626Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.842653Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.842666Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-19T11:44:50.842670Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.842674Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-19T11:44:50.842681Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.842686Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-19T11:44:50.842731Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.842734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.842736Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.842738Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.842740Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.842750Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-19T11:44:50.842753Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842760Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842763Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842766Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842769Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842772Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842775Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842777Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.842779Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-19T11:44:50.842802Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.842815Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-19T11:44:50.842818Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-19T11:44:50.842828Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-19T11:44:50.842839Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-19T11:44:50.842866Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-19T11:44:50.842873Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-19T11:44:50.842898Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-19T11:44:50.842906Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-19T11:44:50.842915Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-19T11:44:50.842923Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-19T11:44:50.842970Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-19T11:44:50.842983Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.842987Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.842991Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.842994Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.842998Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.843002Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.843005Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.843008Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.843014Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.843023Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-19T11:44:50.843057Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-11-19T11:44:50.843067Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-19T11:44:50.843071Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.843076Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-19T11:44:50.843083Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/1
2025-11-19T11:44:50.843091Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-19T11:44:50.843127Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-19T11:44:50.843131Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-11-19T11:44:50.843134Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-19T11:44:50.843135Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.843138Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-19T11:44:50.843285Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-11-19T11:44:50.843289Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-19T11:44:50.843292Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-11-19T11:44:50.843438Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-11-19T11:44:50.843442Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-19T11:44:50.843443Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-11-19T11:44:50.843458Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-11-19T11:44:50.843461Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-19T11:44:50.843647Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048955 count 2 nextOffset 2 batches 3
2025-11-19T11:44:50.843655Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-11-19T11:44:50.843659Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-19T11:44:50.843661Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.843664Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-19T11:44:50.843803Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-11-19T11:44:50.843808Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-19T11:44:50.843811Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-11-19T11:44:50.844342Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-11-19T11:44:50.844346Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-19T11:44:50.844348Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-11-19T11:44:50.844374Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-11-19T11:44:50.844376Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-19T11:44:50.844559Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097710 count 3 nextOffset 3 batches 5
2025-11-19T11:44:50.844564Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-11-19T11:44:50.844570Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-19T11:44:50.844573Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.844576Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-19T11:44:50.844717Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-11-19T11:44:50.844721Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-19T11:44:50.844724Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-11-19T11:44:50.845221Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.845240Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-19T11:44:50.845245Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845249Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845253Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845258Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845261Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845262Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-11-19T11:44:50.845264Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845267Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845269Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.845269Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-19T11:44:50.845272Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-11-19T11:44:50.845289Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-11-19T11:44:50.845292Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-19T11:44:50.845898Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146465 count 4 nextOffset 4 batches 7
2025-11-19T11:44:50.846115Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1763552690836
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.847582Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.848103Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-11-19T11:44:50.848117Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-19T11:44:50.848119Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.848123Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-19T11:44:50.848642Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-11-19T11:44:50.848652Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-19T11:44:50.848656Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-11-19T11:44:50.849188Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-11-19T11:44:50.849195Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-19T11:44:50.849198Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-11-19T11:44:50.849218Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-11-19T11:44:50.849221Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-19T11:44:50.849428Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195220 count 5 nextOffset 5 batches 9
2025-11-19T11:44:50.849435Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-11-19T11:44:50.849440Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-19T11:44:50.849442Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.849447Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-19T11:44:50.849601Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-11-19T11:44:50.849607Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-19T11:44:50.849609Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-11-19T11:44:50.850113Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-11-19T11:44:50.850118Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-19T11:44:50.850121Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-11-19T11:44:50.850135Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-11-19T11:44:50.850138Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-19T11:44:50.850316Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243975 count 6 nextOffset 6 batches 11
2025-11-19T11:44:50.850321Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-11-19T11:44:50.850325Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-19T11:44:50.850327Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.850330Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-19T11:44:50.850485Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-11-19T11:44:50.850489Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-19T11:44:50.850491Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-11-19T11:44:50.850841Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-11-19T11:44:50.850849Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-19T11:44:50.850852Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-11-19T11:44:50.850866Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-11-19T11:44:50.850870Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-19T11:44:50.852096Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|265b750c-cbd6a160-e012942e-de5596ba_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.851257Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702785:3611], now have 1 active actors on pipe
2025-11-19T11:44:50.851825Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.851834Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.851878Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|265b750c-cbd6a160-e012942e-de5596ba_8 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.851892Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.851896Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.851903Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.851905Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.851910Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.851924Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.851928Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.851932Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.851954Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.851977Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.854229Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292730 count 7 nextOffset 7 batches 13
2025-11-19T11:44:50.854264Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-11-19T11:44:50.854271Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-19T11:44:50.854274Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.854278Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-19T11:44:50.854444Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-11-19T11:44:50.854453Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-19T11:44:50.854457Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-11-19T11:44:50.855056Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-11-19T11:44:50.855064Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-19T11:44:50.855067Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-11-19T11:44:50.855100Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-11-19T11:44:50.855104Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-19T11:44:50.855716Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341485 count 8 nextOffset 8 batches 15
2025-11-19T11:44:50.855725Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-11-19T11:44:50.855731Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-19T11:44:50.855733Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.855737Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-19T11:44:50.855880Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-11-19T11:44:50.855886Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-19T11:44:50.855890Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-11-19T11:44:50.856035Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-11-19T11:44:50.856039Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-19T11:44:50.856041Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-11-19T11:44:50.856054Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-11-19T11:44:50.856057Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-19T11:44:50.857798Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702785:3611] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|265b750c-cbd6a160-e012942e-de5596ba_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.864944Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.866278Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702789:3613], now have 1 active actors on pipe
2025-11-19T11:44:50.867741Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.867765Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.867847Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.867903Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.867914Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.867920Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.867943Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.867968Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.867972Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.867985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.867989Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.867995Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.867998Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.868004Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.868060Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-19T11:44:50.868076Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.868081Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-19T11:44:50.868085Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.868089Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-19T11:44:50.868533Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-11-19T11:44:50.868548Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.868551Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.868555Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.868635Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1763552690868
2025-11-19T11:44:50.868834Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.868851Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.872615Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.872639Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.872672Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.872680Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.872695Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-11-19T11:44:50.872698Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.872704Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-11-19T11:44:50.872710Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.872715Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-11-19T11:44:50.872760Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.872764Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.872767Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.872769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.872772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.872786Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000? (186)
2025-11-19T11:44:50.872792Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872795Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872798Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872801Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872804Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872807Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872811Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872814Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037894][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-11-19T11:44:50.872818Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037894][Partition][0][StateIdle] 9 keys were taken away. Let's read 8390426 bytes
2025-11-19T11:44:50.872839Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.872852Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037894][Partition][0][StateIdle] Begin compaction for 9 blobs
2025-11-19T11:44:50.872855Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-19T11:44:50.872866Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-19T11:44:50.872882Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-19T11:44:50.872901Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-19T11:44:50.872910Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-19T11:44:50.872942Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-19T11:44:50.872951Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-19T11:44:50.872959Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-19T11:44:50.872967Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037894][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-19T11:44:50.873035Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037894][Partition][0][StateIdle] Request 9 blobs for compaction
2025-11-19T11:44:50.873046Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 186 accessed 1 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873050Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873054Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873057Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873061Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873064Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873067Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873071Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873075Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:50.873083Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 0. All 9 blobs are from cache.
2025-11-19T11:44:50.873113Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037894][Partition][0][StateIdle] Continue blobs compaction
2025-11-19T11:44:50.873124Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[0/9] d0000000000_00000000000000000000_00000_0000000001_00000?
2025-11-19T11:44:50.873127Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.873131Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00000?, parameters.CurOffset=0
2025-11-19T11:44:50.873139Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 0.0/1
2025-11-19T11:44:50.873147Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-11-19T11:44:50.873185Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 0 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 198 count 1 nextOffset 1 batches 1
2025-11-19T11:44:50.873189Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 0:0 appended
2025-11-19T11:44:50.873192Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[1/9] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-11-19T11:44:50.873194Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.873197Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-11-19T11:44:50.873338Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.873342Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.0/3
2025-11-19T11:44:50.873348Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-11-19T11:44:50.873351Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:0 appended
2025-11-19T11:44:50.873357Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-11-19T11:44:50.873361Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873365Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873368Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873371Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873374Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873377Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873380Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873383Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-11-19T11:44:50.873489Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.1/3
2025-11-19T11:44:50.873495Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-11-19T11:44:50.873497Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:1 appended
2025-11-19T11:44:50.873513Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 1.2/3
2025-11-19T11:44:50.873523Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-11-19T11:44:50.873756Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048955 count 2 nextOffset 2 batches 3
2025-11-19T11:44:50.873763Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 1:2 appended
2025-11-19T11:44:50.873767Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[2/9] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-11-19T11:44:50.873770Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.873773Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-11-19T11:44:50.873945Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.0/3
2025-11-19T11:44:50.873950Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-11-19T11:44:50.873952Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:0 appended
2025-11-19T11:44:50.874527Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.1/3
2025-11-19T11:44:50.874534Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-11-19T11:44:50.874537Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:1 appended
2025-11-19T11:44:50.874554Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 2.2/3
2025-11-19T11:44:50.874556Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-11-19T11:44:50.875228Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097710 count 3 nextOffset 3 batches 5
2025-11-19T11:44:50.875236Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 2:2 appended
2025-11-19T11:44:50.875241Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[3/9] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-11-19T11:44:50.875243Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.875247Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-11-19T11:44:50.875417Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.0/3
2025-11-19T11:44:50.875424Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-11-19T11:44:50.875426Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:0 appended
2025-11-19T11:44:50.875990Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.1/3
2025-11-19T11:44:50.875996Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-11-19T11:44:50.875999Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:1 appended
2025-11-19T11:44:50.876015Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 3.2/3
2025-11-19T11:44:50.876019Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-11-19T11:44:50.876634Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146465 count 4 nextOffset 4 batches 7
2025-11-19T11:44:50.876640Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 3:2 appended
2025-11-19T11:44:50.876644Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[4/9] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-11-19T11:44:50.876646Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.876649Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-11-19T11:44:50.876807Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.0/3
2025-11-19T11:44:50.876813Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-11-19T11:44:50.876815Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:0 appended
2025-11-19T11:44:50.877380Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1763552690867
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.878940Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.880306Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.1/3
2025-11-19T11:44:50.880328Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-11-19T11:44:50.880333Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:1 appended
2025-11-19T11:44:50.880355Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 4.2/3
2025-11-19T11:44:50.880359Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-11-19T11:44:50.880575Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195220 count 5 nextOffset 5 batches 9
2025-11-19T11:44:50.880583Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 4:2 appended
2025-11-19T11:44:50.880588Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[5/9] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-11-19T11:44:50.880591Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.880595Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-11-19T11:44:50.880732Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.0/3
2025-11-19T11:44:50.880737Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-11-19T11:44:50.880741Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:0 appended
2025-11-19T11:44:50.881281Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.1/3
2025-11-19T11:44:50.881287Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-11-19T11:44:50.881291Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:1 appended
2025-11-19T11:44:50.881309Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 5.2/3
2025-11-19T11:44:50.881313Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-11-19T11:44:50.881939Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243975 count 6 nextOffset 6 batches 11
2025-11-19T11:44:50.881946Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 5:2 appended
2025-11-19T11:44:50.881951Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[6/9] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-11-19T11:44:50.881953Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.881957Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-11-19T11:44:50.882114Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.0/3
2025-11-19T11:44:50.882121Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-11-19T11:44:50.882123Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:0 appended
2025-11-19T11:44:50.882308Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.1/3
2025-11-19T11:44:50.882313Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-11-19T11:44:50.882316Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:1 appended
2025-11-19T11:44:50.882328Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 6.2/3
2025-11-19T11:44:50.882331Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-11-19T11:44:50.882539Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292730 count 7 nextOffset 7 batches 13
2025-11-19T11:44:50.882544Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 6:2 appended
2025-11-19T11:44:50.882551Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[7/9] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-11-19T11:44:50.882553Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.882557Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-11-19T11:44:50.882756Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.0/3
2025-11-19T11:44:50.882763Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-11-19T11:44:50.882765Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:0 appended
2025-11-19T11:44:50.882930Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.1/3
2025-11-19T11:44:50.882934Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-11-19T11:44:50.882936Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:1 appended
2025-11-19T11:44:50.882949Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 7.2/3
2025-11-19T11:44:50.882952Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-11-19T11:44:50.883162Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365504
2025-11-19T11:44:50.883176Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1104: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365504 WTime 1763552690882
2025-11-19T11:44:50.883210Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-19T11:44:50.883215Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-11-19T11:44:50.883267Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1763552690882
2025-11-19T11:44:50.883317Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702780:3608] destroyed
2025-11-19T11:44:50.883329Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702794:3616], now have 1 active actors on pipe
2025-11-19T11:44:50.883335Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.883348Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365504
2025-11-19T11:44:50.883356Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-19T11:44:50.883525Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341485 count 8 nextOffset 8 batches 15
2025-11-19T11:44:50.883531Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 7:2 appended
2025-11-19T11:44:50.883536Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037894][Partition][0][StateIdle] key[8/9] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-11-19T11:44:50.883538Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037894][Partition][0][StateIdle] Need to compact head 0
2025-11-19T11:44:50.883541Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037894][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-11-19T11:44:50.883686Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.0/3
2025-11-19T11:44:50.883690Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-11-19T11:44:50.883693Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:0 appended
2025-11-19T11:44:50.883835Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.1/3
2025-11-19T11:44:50.883839Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-11-19T11:44:50.883843Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:1 appended
2025-11-19T11:44:50.883854Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037894][Partition][0][StateIdle] Try append part 8.2/3
2025-11-19T11:44:50.883857Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-11-19T11:44:50.889246Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.889272Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.889329Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|58420f7d-6e8ea3e7-6fbc15fe-ad049596_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.889345Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.889350Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.889361Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.889363Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.889369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.889384Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.889387Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.889393Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.889416Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.889440Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.889633Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|58420f7d-6e8ea3e7-6fbc15fe-ad049596_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|58420f7d-6e8ea3e7-6fbc15fe-ad049596_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.897744Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702794:3616] destroyed
2025-11-19T11:44:50.898573Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.905289Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702801:3619], now have 1 active actors on pipe
2025-11-19T11:44:50.905734Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.905746Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.905940Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.906011Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.906023Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.906029Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.906056Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.906081Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.906108Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.906121Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.906124Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.906129Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.906131Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.906137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.906175Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-19T11:44:50.906191Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.906194Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-19T11:44:50.906199Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.906202Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-19T11:44:50.906509Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-19T11:44:50.906523Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.906525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.906529Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.906609Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1763552690906
2025-11-19T11:44:50.906794Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.906808Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.919873Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-19T11:44:50.919056Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365504 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.919075Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.919091Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.919103Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.919181Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-19T11:44:50.919185Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.919189Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.919219Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.919227Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.919241Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1763552690906
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 12
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-19T11:44:50.919244Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.919250Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-19T11:44:50.919274Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.919278Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-19T11:44:50.919308Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.919312Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.919314Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.919317Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.919319Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.919367Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.919388Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.919405Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.919414Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-19T11:44:50.919416Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-19T11:44:50.919418Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-19T11:44:50.919420Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-19T11:44:50.919423Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
CallPersQueueGRPC request to localhost:2025-11-19T11:44:50.919425Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
11286
2025-11-19T11:44:50.919428Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-19T11:44:50.919430Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-19T11:44:50.919433Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-19T11:44:50.919682Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365504
2025-11-19T11:44:50.919688Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.919695Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.921423Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.922415Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702801:3619] destroyed
2025-11-19T11:44:50.922453Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-19T11:44:50.923109Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923116Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923122Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923126Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923132Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923137Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923143Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923153Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923159Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.923176Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.923198Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.923209Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.923213Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.923215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.923218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.923221Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.923233Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.923320Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-19T11:44:50.923327Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923336Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923343Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923354Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923359Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923366Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923371Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.923378Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.928334Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:50.927417Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob sourceId '' seqNo 8 partNo 2 result is x0000000000_00000000000000000000_00000_0000000008_00016 size 8365504
2025-11-19T11:44:50.927443Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1104: [72075186224037894][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic12' partition 0 old key x0000000000_00000000000000000000_00000_0000000008_00016 new key d0000000000_00000000000000000000_00000_0000000008_00016 size 8365504 WTime 1763552690925
2025-11-19T11:44:50.927492Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 1 NewHead: Offset 8 PartNo 2 PackedSize 24736 count 1 nextOffset 9 batches 1
2025-11-19T11:44:50.927504Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037894][Partition][0][StateIdle] Part 8:2 appended
2025-11-19T11:44:50.927572Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 8,1 HeadOffset 0 endOffset 0 curOffset 9 d0000000000_00000000000000000008_00002_0000000001_00000| size 24726 WTime 1763552690925
2025-11-19T11:44:50.927625Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702789:3613] destroyed
2025-11-19T11:44:50.927642Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.927646Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.927649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.927652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.927654Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.927677Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702808:3624], now have 1 active actors on pipe
2025-11-19T11:44:50.927707Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.927714Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.927733Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.927747Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 8 size 8365504
2025-11-19T11:44:50.927756Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 2 count 1 size 24726
2025-11-19T11:44:50.927791Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6faf7430-13b5ba70-7d87c1ac-3b177c00_9 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:50.927798Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.927801Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.927806Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.927808Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.927812Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.927825Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.927829Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.927832Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.927845Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.927906Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6faf7430-13b5ba70-7d87c1ac-3b177c00_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6faf7430-13b5ba70-7d87c1ac-3b177c00_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.940967Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702808:3624] destroyed
2025-11-19T11:44:50.961316Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.963402Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401131379702817:3631], now have 1 active actors on pipe
2025-11-19T11:44:50.965552Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:50.965576Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:50.965685Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.965867Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.965881Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.965887Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.965920Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.965946Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.965950Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.965960Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.965963Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.965969Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.965973Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.965987Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.966041Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-11-19T11:44:50.966071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.966075Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-11-19T11:44:50.966083Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.966088Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-11-19T11:44:50.966371Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-11-19T11:44:50.966412Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.966416Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.966420Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.966498Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1763552690964
2025-11-19T11:44:50.967105Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.967129Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.973164Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
2025-11-19T11:44:50.970946Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 8 size 8365504 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.970963Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 24726 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.971153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.971249Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037894][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-19T11:44:50.971253Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.971350Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0' size 8365504
2025-11-19T11:44:50.971355Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 8 partno 2 count 1 parts 0 suffix '124' size 24726
2025-11-19T11:44:50.972284Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.972299Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.972351Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.972359Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.972372Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-11-19T11:44:50.972380Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.972385Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-11-19T11:44:50.972395Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.972400Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-11-19T11:44:50.972435Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.972439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.972443Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.972446Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.972448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.972491Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.972512Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:50.972527Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.972535Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00000?(+) to d0000000000_00000000000000000000_00000_0000000001_00000?(+)
2025-11-19T11:44:50.972540Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972541Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972544Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972545Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1763552690964
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-11-19T11:44:50.972547Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972552Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972555Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972558Z node 5 :PERSQUEUE DEBUG: read.h:350: [72075186224037894][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-11-19T11:44:50.972820Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:50.975220Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401131379702817:3631] destroyed
2025-11-19T11:44:50.975329Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975335Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975371Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975375Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975381Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975385Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975390Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975394Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975400Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:50.975419Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.975439Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.975451Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.975454Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.975457Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.975459Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.975463Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.977239Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.975476Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.975555Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 186
2025-11-19T11:44:50.975563Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975572Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975580Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975596Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975601Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975607Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975612Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.975618Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037894' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:50.977976Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702825:3637], now have 1 active actors on pipe
2025-11-19T11:44:50.978215Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.978228Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.978292Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a96db00a-6256d86c-c8b96379-f6373929_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:50.978307Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.978311Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.978316Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:50.978321Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.978332Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.978346Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:50.978349Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:50.978352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.978382Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:50.978404Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a96db00a-6256d86c-c8b96379-f6373929_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:50.978582Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a96db00a-6256d86c-c8b96379-f6373929_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:50.984886Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702825:3637] destroyed
2025-11-19T11:44:50.988335Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:50.989081Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401131379702828:3638], now have 1 active actors on pipe
2025-11-19T11:44:50.990493Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:50.990515Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:50.990617Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:50.990865Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:50.990877Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:50.990883Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:50.990910Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:50.990935Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.990940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.990959Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.990962Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:50.990967Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:50.990969Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.990975Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.991015Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-19T11:44:50.991041Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.991047Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-19T11:44:50.991051Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:50.991054Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-19T11:44:50.991308Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-19T11:44:50.991321Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:50.991324Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:50.991328Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.991411Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1763552690990
2025-11-19T11:44:50.991607Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:50.991622Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-19T11:44:50.998781Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:50.998817Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:50.998869Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:50.998887Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.998908Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-19T11:44:50.998913Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.998918Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-19T11:44:50.998924Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:50.998928Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-19T11:44:50.998976Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:50.998983Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.998985Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:50.998988Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:50.998990Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:50.999003Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:50.999027Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.001775Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.001961Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.002463Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401131379702828:3638] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1763552690990
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.004339Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.005172Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670129:3641], now have 1 active actors on pipe
2025-11-19T11:44:51.005385Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.005396Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.005445Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d8f2f83c-f8819965-d8011379-552f0dc2_10 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:51.005459Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.005464Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.005471Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.005474Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.005479Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.005494Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.005497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.005503Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.005527Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.005548Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.005711Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.006375Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670129:3641] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d8f2f83c-f8819965-d8011379-552f0dc2_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|d8f2f83c-f8819965-d8011379-552f0dc2_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.015478Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.016991Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670132:3642], now have 1 active actors on pipe
2025-11-19T11:44:51.018786Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.018820Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.018908Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.018967Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.018978Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.018984Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.019012Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.019037Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.019042Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.019055Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.019059Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.019064Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.019066Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.019073Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.019121Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-11-19T11:44:51.019138Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.019143Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-11-19T11:44:51.019147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.019149Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-11-19T11:44:51.019432Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-11-19T11:44:51.019444Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.019447Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.019451Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.019533Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1763552691019
2025-11-19T11:44:51.019700Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.019714Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.023175Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.023187Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.023190Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.023194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.023196Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.024375Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:51.024400Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.024436Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.024443Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.024457Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-11-19T11:44:51.024460Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.024465Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-11-19T11:44:51.024472Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.024476Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-11-19T11:44:51.024519Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.024525Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.024526Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.024528Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.024530Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.024538Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.024561Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.024718Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.024816Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1763552691018
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.026327Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.026917Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.026929Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.026937Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.026941Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.026943Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.026966Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670132:3642] destroyed
2025-11-19T11:44:51.026985Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670138:3646], now have 1 active actors on pipe
2025-11-19T11:44:51.027237Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.027251Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.027284Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ae6c0924-3b5895d3-7afbc919-94dab5ff_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:51.027294Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.027297Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.027302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.027305Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.027309Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.027321Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.027324Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.027327Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.027341Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.027356Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.027484Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.027874Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670138:3646] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ae6c0924-3b5895d3-7afbc919-94dab5ff_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ae6c0924-3b5895d3-7afbc919-94dab5ff_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.035698Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.036548Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670141:3647], now have 1 active actors on pipe
2025-11-19T11:44:51.037975Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.037999Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.038084Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.038147Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.038158Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.038163Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.038191Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.038215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.038219Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.038230Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.038233Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.038239Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.038241Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.038247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.038288Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-19T11:44:51.038302Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.038306Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-19T11:44:51.038310Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.038313Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-19T11:44:51.038607Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-19T11:44:51.038619Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.038623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.038627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.038725Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1763552691038
2025-11-19T11:44:51.038888Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.038902Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.047155Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:51.047195Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.047236Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.047252Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.047273Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-19T11:44:51.047283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.047288Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-19T11:44:51.047296Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.047305Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-19T11:44:51.047355Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.047398Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.047401Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.047403Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.047405Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.047418Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.047444Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.047515Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.047597Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1763552691037
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 9
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.048316Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670141:3647] destroyed
2025-11-19T11:44:51.048895Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.049383Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670146:3650], now have 1 active actors on pipe
2025-11-19T11:44:51.049561Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.049571Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.049606Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|341de37a-6b82786e-778a8b9c-e246db7d_11 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:51.049617Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.049620Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.049626Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.049627Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.049631Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.049641Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.049644Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.049646Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.049662Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.049677Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.049771Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|341de37a-6b82786e-778a8b9c-e246db7d_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|341de37a-6b82786e-778a8b9c-e246db7d_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.057804Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670146:3650] destroyed
2025-11-19T11:44:51.057953Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.058700Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670149:3651], now have 1 active actors on pipe
2025-11-19T11:44:51.059934Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.059957Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.060046Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.060110Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.060121Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.060128Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.060151Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.060177Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.060182Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.060194Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.060203Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.060208Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.060210Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.060217Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.060259Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-11-19T11:44:51.060273Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.060277Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-11-19T11:44:51.060281Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.060288Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-11-19T11:44:51.060571Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-11-19T11:44:51.060582Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.060585Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.060589Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.060674Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1763552691060
2025-11-19T11:44:51.060839Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.060853Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.064927Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:51.064963Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.064980Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.064996Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.065007Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.065037Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-11-19T11:44:51.065041Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.065045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-11-19T11:44:51.065052Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.065057Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-11-19T11:44:51.065102Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.065106Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.065108Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.065111Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.065113Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.065126Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.065149Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.065338Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.066029Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670149:3651] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1763552691059
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.066907Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.067509Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670154:3654], now have 1 active actors on pipe
2025-11-19T11:44:51.067674Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.067684Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.067725Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3090249a-2550f518-e6ca1eda-d5514250_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:51.067734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.067738Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.067744Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.067746Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.067752Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.067765Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.067768Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.067772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.067788Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.067804Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.067996Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.068414Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670154:3654] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3090249a-2550f518-e6ca1eda-d5514250_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|3090249a-2550f518-e6ca1eda-d5514250_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.076136Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.076900Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670157:3655], now have 1 active actors on pipe
2025-11-19T11:44:51.078429Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.078457Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.078544Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.078605Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.078618Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.078627Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.078664Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.078688Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.078692Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.078703Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.078705Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.078713Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.078715Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.078721Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.078760Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-19T11:44:51.078774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.078778Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-19T11:44:51.078781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.078785Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-19T11:44:51.079055Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-19T11:44:51.079064Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.079067Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.079071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.079152Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1763552691078
2025-11-19T11:44:51.079299Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.079314Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.083189Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:51.083218Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.083251Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.083258Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.083272Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-19T11:44:51.083276Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.083283Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-19T11:44:51.083290Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.083296Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-19T11:44:51.083340Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.083343Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.083346Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.083349Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.083352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.083364Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.083385Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.083537Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.084118Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670157:3655] destroyed
2025-11-19T11:44:51.083623Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1763552691078
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.086042Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.086668Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670162:3658], now have 1 active actors on pipe
2025-11-19T11:44:51.086870Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.086881Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.086917Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8f5f2256-92a02323-e9b8f8f3-8a1a26b0_12 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:51.086930Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.086934Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.086940Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.086945Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.086950Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.086961Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.086964Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.086967Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.086986Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.087005Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.087152Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8f5f2256-92a02323-e9b8f8f3-8a1a26b0_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|8f5f2256-92a02323-e9b8f8f3-8a1a26b0_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.094781Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.092430Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670162:3658] destroyed
2025-11-19T11:44:51.095485Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670165:3659], now have 1 active actors on pipe
2025-11-19T11:44:51.097367Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.097389Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.097480Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.097549Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.097576Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.097581Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.097606Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.097644Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.097649Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.097662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.097668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.097673Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.097675Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.097680Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.097719Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-11-19T11:44:51.097734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.097737Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-11-19T11:44:51.097741Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.097747Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-11-19T11:44:51.098021Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-11-19T11:44:51.098031Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.098034Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.098038Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.098122Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1763552691097
2025-11-19T11:44:51.098276Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.098289Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.102414Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:51.102439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.102469Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.102477Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.102491Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-11-19T11:44:51.102495Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.102500Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-11-19T11:44:51.102506Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.102511Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-11-19T11:44:51.102553Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.102558Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.102560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.102563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.102565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.102576Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.102598Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.102764Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.102854Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1763552691096
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 5
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.104280Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.104933Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670165:3659] destroyed
2025-11-19T11:44:51.104958Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670170:3662], now have 1 active actors on pipe
2025-11-19T11:44:51.105171Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.105183Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.105221Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6de70614-224bcb26-bf7da50f-f5428ad9_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:51.105234Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.105238Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.105244Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.105246Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.105251Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.105264Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.105268Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.105271Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.105290Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.105307Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.105463Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6de70614-224bcb26-bf7da50f-f5428ad9_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|6de70614-224bcb26-bf7da50f-f5428ad9_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.109210Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670170:3662] destroyed
2025-11-19T11:44:51.118851Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.122000Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670175:3663], now have 1 active actors on pipe
2025-11-19T11:44:51.122383Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.122397Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.122487Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.122556Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.122565Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.122570Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.122596Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.122618Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.122623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.122653Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.122656Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.122660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.122662Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.122668Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.122712Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-19T11:44:51.122728Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.122731Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-19T11:44:51.122734Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.122736Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-19T11:44:51.123017Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-19T11:44:51.123030Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.123033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.123037Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.123115Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1763552691122
2025-11-19T11:44:51.123282Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.123296Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.125750Z node 5 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Writing. Can't process user action and tx events
2025-11-19T11:44:51.126743Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.126769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.126772Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.126778Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.126780Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.127515Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:51.127540Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.127563Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.127567Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.127575Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.127587Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-19T11:44:51.127591Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.127596Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-19T11:44:51.127604Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.127608Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-19T11:44:51.127652Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.127654Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.127656Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.127658Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.127660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.127669Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.127687Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.127772Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1763552691122
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.129120Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.129555Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670175:3663] destroyed
2025-11-19T11:44:51.129590Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670180:3668], now have 1 active actors on pipe
2025-11-19T11:44:51.129715Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.129726Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.129764Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a3d5449e-8588db34-ca6f1bd3-8130441f_13 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:51.129774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.129779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.129785Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.129787Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.129792Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.129804Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.129807Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.129811Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.129828Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.129845Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.129905Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a3d5449e-8588db34-ca6f1bd3-8130441f_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|a3d5449e-8588db34-ca6f1bd3-8130441f_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.138505Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670180:3668] destroyed
2025-11-19T11:44:51.138619Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.139946Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670183:3669], now have 1 active actors on pipe
2025-11-19T11:44:51.141324Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.141349Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.141439Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.141503Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.141513Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.141519Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.141544Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.141567Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.141571Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.141583Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.141586Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.141590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.141593Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.141598Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.141638Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-11-19T11:44:51.141654Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.141657Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-11-19T11:44:51.141660Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.141667Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-11-19T11:44:51.141998Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-11-19T11:44:51.142011Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.142015Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.142021Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.142101Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1763552691141
2025-11-19T11:44:51.142655Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.142667Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.146407Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:51.146433Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.146463Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.146471Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.146488Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-11-19T11:44:51.146492Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.146497Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-11-19T11:44:51.146504Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.146509Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-11-19T11:44:51.146556Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.146559Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.146561Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.146563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.146565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.146578Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.146599Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.146771Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.146900Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.147683Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670183:3669] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1763552691141
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 3
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.148633Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.149355Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670188:3672], now have 1 active actors on pipe
2025-11-19T11:44:51.149374Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.149381Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.149420Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|1c2c81dc-17a0ede5-2dc8724c-1ec147af_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:51.149432Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.149439Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.149446Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.149448Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.149453Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.149467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.149470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.149473Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.149492Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.149509Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.149691Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.150251Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670188:3672] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|1c2c81dc-17a0ede5-2dc8724c-1ec147af_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|1c2c81dc-17a0ede5-2dc8724c-1ec147af_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.156537Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.157306Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670191:3673], now have 1 active actors on pipe
2025-11-19T11:44:51.158736Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.158765Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.158853Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.158915Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.158923Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.158932Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.158953Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.158976Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.158981Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.158991Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.158993Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.158998Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.159000Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.159006Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.159045Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-19T11:44:51.159060Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.159064Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-19T11:44:51.159068Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.159070Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-19T11:44:51.159344Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-19T11:44:51.159363Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.159367Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.159373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.159444Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1763552691159
2025-11-19T11:44:51.159986Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.160008Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.163143Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:51.163168Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.163198Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.163207Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.163220Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-19T11:44:51.163224Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.163229Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-19T11:44:51.163236Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.163240Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-19T11:44:51.163281Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.163285Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.163287Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.163290Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.163293Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.163305Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.163327Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.163389Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.163590Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.164341Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670191:3673] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1763552691158
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.165178Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.165933Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670196:3676], now have 1 active actors on pipe
2025-11-19T11:44:51.165959Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.165967Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.166020Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a267c9f6-9dc806b8-38a97212-f467c87_14 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:51.166047Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.166051Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.166057Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.166059Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.166065Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.166079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.166087Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.166090Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.166120Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.166143Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.166206Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a267c9f6-9dc806b8-38a97212-f467c87_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:51.166784Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670196:3676] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|a267c9f6-9dc806b8-38a97212-f467c87_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.174662Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670199:3677], now have 1 active actors on pipe
2025-11-19T11:44:51.175993Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.173932Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.176018Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.176097Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.176157Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.176166Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.176172Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.176196Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.176220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.176225Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.176239Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.176242Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.176247Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.176250Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.176256Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.176296Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-11-19T11:44:51.176313Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.176317Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-11-19T11:44:51.176320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.176323Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-11-19T11:44:51.176596Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-11-19T11:44:51.176608Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.176611Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.176615Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.176696Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1763552691176
2025-11-19T11:44:51.176864Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.176878Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.180987Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:51.181033Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.181065Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.181074Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.181088Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-11-19T11:44:51.181092Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.181096Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-11-19T11:44:51.181103Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.181107Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-11-19T11:44:51.181153Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.181157Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.181159Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.181163Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.181166Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.181181Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.181203Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.181356Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-11-19T11:44:51.181998Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670199:3677] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1763552691176
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 4
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.181450Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.186030Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670204:3680], now have 1 active actors on pipe
2025-11-19T11:44:51.186052Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.186059Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.186095Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cbf66204-17edce21-871b5f6-9e3d127f_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-11-19T11:44:51.186109Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.186114Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.186122Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.186125Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.186130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.186144Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.186147Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.186150Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.186171Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.186194Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cbf66204-17edce21-871b5f6-9e3d127f_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
2025-11-19T11:44:51.185283Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.186389Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cbf66204-17edce21-871b5f6-9e3d127f_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.194119Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.196391Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670204:3680] destroyed
2025-11-19T11:44:51.196414Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670208:3681], now have 1 active actors on pipe
2025-11-19T11:44:51.196790Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.196801Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.196882Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.196938Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.196947Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.196952Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.197001Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.197046Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.197051Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.197064Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.197066Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.197071Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.197073Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.197079Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.197117Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-19T11:44:51.197130Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.197134Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-19T11:44:51.197137Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037892][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.197141Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-19T11:44:51.197449Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-19T11:44:51.197461Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.197464Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.197467Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.197547Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1763552691196
2025-11-19T11:44:51.198482Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.198510Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.204318Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7574401126572128561:2358]
2025-11-19T11:44:51.204347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.204383Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.204391Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.204407Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-19T11:44:51.204412Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.204417Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-19T11:44:51.204424Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.204428Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-19T11:44:51.204470Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.204475Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.204478Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.204483Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.204486Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.204499Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.204520Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.204671Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1763552691196
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 7
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-11-19T11:44:51.204751Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.206454Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.207040Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670208:3681] destroyed
2025-11-19T11:44:51.207063Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670214:3685], now have 1 active actors on pipe
2025-11-19T11:44:51.207266Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.207276Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.207314Z node 5 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6ff96536-dad88cc9-6751b808-1c397fb7_15 generated for partition 0 topic 'rt3.dc1--topic12' owner default
2025-11-19T11:44:51.207332Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.207337Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.207344Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 1, PendingWrites: 0
2025-11-19T11:44:51.207347Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.207352Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.207366Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 1
2025-11-19T11:44:51.207369Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (1)
2025-11-19T11:44:51.207373Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.207394Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-11-19T11:44:51.207413Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.208113Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670214:3685] destroyed
2025-11-19T11:44:51.207592Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6ff96536-dad88cc9-6751b808-1c397fb7_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  OwnerCookie: "default|6ff96536-dad88cc9-6751b808-1c397fb7_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-11-19T11:44:51.218385Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670217:3686], now have 1 active actors on pipe
2025-11-19T11:44:51.219918Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.219945Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.220063Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-11-19T11:44:51.220130Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-11-19T11:44:51.220139Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:1977: [PQ: 72075186224037894] got client PART message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-11-19T11:44:51.220146Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2011: [PQ: 72075186224037894] got client message topic: rt3.dc1--topic12 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-11-19T11:44:51.220174Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:634: [72075186224037894][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-11-19T11:44:51.220215Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.220220Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.220232Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.220235Z node 5 :PERSQUEUE DEBUG: partition.cpp:2406: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxEvent(TMessage)
2025-11-19T11:44:51.220241Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 3, PendingWrites: 0
2025-11-19T11:44:51.220243Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.217611Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.220249Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.220290Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-11-19T11:44:51.220304Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.220308Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-11-19T11:44:51.220312Z node 5 :PERSQUEUE DEBUG: partition.cpp:2470: [72075186224037894][Partition][0][StateIdle] TPartition::ProcessUserActionAndTxPendingCommit(TMessage)
2025-11-19T11:44:51.220316Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1326: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-11-19T11:44:51.220561Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1430: [72075186224037894][Partition][0][StateIdle] Topic 'rt3.dc1--topic12' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-11-19T11:44:51.220584Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 3
2025-11-19T11:44:51.220590Z node 5 :PERSQUEUE DEBUG: partition.cpp:2325: [72075186224037894][Partition][0][StateIdle] Batch completed (3)
2025-11-19T11:44:51.220594Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.220683Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:1682: [72075186224037894][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic12' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1763552691220
2025-11-19T11:44:51.220888Z node 5 :PERSQUEUE DEBUG: read.h:275: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-11-19T11:44:51.220903Z node 5 :PERSQUEUE DEBUG: read.h:313: [72075186224037894][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-11-19T11:44:51.226483Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.226497Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.226502Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.226507Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.226510Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.226607Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [5:7574401126572128630:2361]
2025-11-19T11:44:51.226623Z node 5 :PERSQUEUE DEBUG: partition.cpp:2136: [72075186224037894][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-11-19T11:44:51.226667Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:570: [72075186224037894][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-11-19T11:44:51.226675Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.226691Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-11-19T11:44:51.226696Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.226701Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-11-19T11:44:51.226709Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037894][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-11-19T11:44:51.226714Z node 5 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037894][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic12', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-11-19T11:44:51.226767Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.226769Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.226774Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.226777Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.226779Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.226786Z node 5 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037894][Partition][0][StateIdle] No data for blobs compaction
2025-11-19T11:44:51.226808Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.226979Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037894' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1763552691219
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 6
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-19T11:44:51.228546Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.228558Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.228560Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.228563Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.228565Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.228587Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670217:3686] destroyed
2025-11-19T11:44:51.229682Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037892] server connected, pipe [4:7574401135674670222:3689], now have 1 active actors on pipe
2025-11-19T11:44:51.229939Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-11-19T11:44:51.229950Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-11-19T11:44:51.230534Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-19T11:44:51.230604Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365504 count 9 last offset 0, current partition end offset: 16
2025-11-19T11:44:51.230626Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-19T11:44:51.230656Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365504 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:51.230668Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-19T11:44:51.230699Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-19T11:44:51.230991Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512170 from pos 0 cbcount 2
2025-11-19T11:44:51.231040Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.227065Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
2025-11-19T11:44:51.229103Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.231206Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-19T11:44:51.231341Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1763552690507
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
CallPersQueueGRPC request to localhost:11286
PartitionRequest {
  Topic: "rt3.dc1--topic12"
  Partition: 0
  CmdRead {
    ClientId: "user1"
    Offset: 0
    Count: 1
    ReadTimestampMs: 0
  }
}
2025-11-19T11:44:51.233068Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1365: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-11-19T11:44:51.234394Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037892] server disconnected, pipe [4:7574401135674670222:3689] destroyed
2025-11-19T11:44:51.234428Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2721: [PQ: 72075186224037894] server connected, pipe [4:7574401135674670225:3690], now have 1 active actors on pipe
2025-11-19T11:44:51.234452Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic12' requestId: <none>
2025-11-19T11:44:51.234460Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2635: [PQ: 72075186224037894] got client message batch for topic 'rt3.dc1--topic12' partition 0
2025-11-19T11:44:51.234954Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:887: [72075186224037894][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic12' partition 0 user user1 offset 0 partno 0 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 0
2025-11-19T11:44:51.234995Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1112: [72075186224037894][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 8365504 count 9 last offset 0, current partition end offset: 16
2025-11-19T11:44:51.234999Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:1128: [72075186224037894][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-11-19T11:44:51.235014Z node 5 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 8 parts_count 16 source 1 size 8365504 accessed 0 times before, last time 2025-11-19T11:44:50.000000Z
2025-11-19T11:44:51.235029Z node 5 :PERSQUEUE DEBUG: read.h:126: [72075186224037894][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-11-19T11:44:51.235056Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:576: FormAnswer for 1 blobs
2025-11-19T11:44:51.235250Z node 5 :PERSQUEUE DEBUG: partition_read.cpp:496: FormAnswer processing batch offset 0 totakecount 8 count 1 size 512170 from pos 0 cbcount 2
2025-11-19T11:44:51.235296Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic12' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-11-19T11:44:51.235516Z node 5 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037894' partition 0 offset 0 partno 0 count 8 parts 16 suffix '0'
2025-11-19T11:44:51.235723Z node 4 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 16
    Result {
      Offset: 0
      Data: "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"
      SourceId: "source1"
      SeqNo: 0
      WriteTimestampMS: 1763552690514
      CreateTimestampMS: 0
      UncompressedSize: 0
      PartitionKey: ""
      ExplicitHash: ""
    }
    BlobsFromDisk: 0
    BlobsFromCache: 1
    SizeLag: 7341294
    RealReadOffset: 0
    WaitQuotaTimeMs: 0
    EndOffset: 16
    StartOffset: 0
  }
}
2025-11-19T11:44:51.238243Z node 5 :PERSQUEUE DEBUG: pq_impl.cpp:2746: [PQ: 72075186224037894] server disconnected, pipe [4:7574401135674670225:3690] destroyed
2025-11-19T11:44:51.327330Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.327351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.327353Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.327360Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.327363Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.331320Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.331351Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.331354Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.331357Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.331360Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.429663Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037892][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.429683Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.429686Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037892][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.429690Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037892][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.429693Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037892][Partition][0][StateIdle] Try persist
2025-11-19T11:44:51.434759Z node 5 :PERSQUEUE DEBUG: partition.cpp:2312: [72075186224037894][Partition][0][StateIdle] Process user action and tx events
2025-11-19T11:44:51.434781Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.434784Z node 5 :PERSQUEUE DEBUG: partition.cpp:2320: [72075186224037894][Partition][0][StateIdle] Process user action and tx pending commits
2025-11-19T11:44:51.434788Z node 5 :PERSQUEUE DEBUG: partition.cpp:2371: [72075186224037894][Partition][0][StateIdle] Events: 0, PendingCommits: 0, PendingWrites: 0
2025-11-19T11:44:51.434791Z node 5 :PERSQUEUE DEBUG: partition.cpp:2330: [72075186224037894][Partition][0][StateIdle] Try persist
