2025-10-31T08:23:26.336536Z node 24 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[24:7567298610742800272:2078];send_to=[0:7307199536658146131:7762515];
2025-10-31T08:23:26.337512Z node 24 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-31T08:23:26.473974Z node 24 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/7ydd/000fe9/r3tmp/tmpBhaT7x/pdisk_1.dat
2025-10-31T08:23:26.508230Z node 24 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:23:26.563840Z node 25 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-31T08:23:26.564776Z node 25 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-31T08:23:26.569605Z node 25 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:23:26.716396Z node 24 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:23:26.744662Z node 25 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-31T08:23:26.902841Z node 24 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-31T08:23:26.947030Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(24, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T08:23:26.947171Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(24, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T08:23:26.948786Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(25, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-31T08:23:26.948886Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(25, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-31T08:23:26.960999Z node 24 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 25 Cookie 25
2025-10-31T08:23:26.961235Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(24, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-31T08:23:26.964058Z node 24 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(25, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 13378, node 24
2025-10-31T08:23:27.129009Z node 24 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/7ydd/000fe9/r3tmp/yandexVEQ8a2.tmp
2025-10-31T08:23:27.129040Z node 24 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/7ydd/000fe9/r3tmp/yandexVEQ8a2.tmp
2025-10-31T08:23:27.129223Z node 24 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/7ydd/000fe9/r3tmp/yandexVEQ8a2.tmp
2025-10-31T08:23:27.129443Z node 24 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-31T08:23:27.136017Z node 24 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T08:23:27.227522Z INFO: TTestServer started on Port 1544 GrpcPort 13378
2025-10-31T08:23:27.276050Z node 25 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-31T08:23:27.416209Z node 24 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-31T08:23:27.506613Z node 25 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
TClient is connected to server localhost:1544
PQClient connected to localhost:13378
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-31T08:23:28.015401Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
2025-10-31T08:23:28.128751Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
waiting...
waiting...
waiting...
2025-10-31T08:23:31.320016Z node 24 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[24:7567298610742800272:2078];send_to=[0:7307199536658146131:7762515];
2025-10-31T08:23:31.320126Z node 24 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-31T08:23:36.274895Z node 25 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [25:7567298653876536812:2302], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T08:23:36.276376Z node 25 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=25&id=YTJhOTNmNjEtZDY1YjZhMTktMjg2YjY3ODYtY2RlZjI3ZmY=, ActorId: [25:7567298653876536810:2301], ActorState: ExecuteState, TraceId: 01k8wntvxha1t360a3nwry8a1w, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T08:23:36.277005Z node 25 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T08:23:36.726840Z node 24 :KQP_PROXY ERROR: kqp_proxy_service.cpp:1316: TraceId: "01k8wntmga3dedyycx7xyh1v0p", Request deadline has expired for 3.216875s seconds
2025-10-31T08:23:36.835755Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T08:23:36.883113Z node 24 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [24:7567298653692474394:2336], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T08:23:36.884436Z node 24 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=24&id=ZmE4NWI4Y2EtOGVjMDFhNDctMTk5MzVhYzgtMTY4MzIyMmQ=, ActorId: [24:7567298653692474392:2335], ActorState: ExecuteState, TraceId: 01k8wntwgw94rkc3ex5gh6fjk1, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T08:23:36.884993Z node 24 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-31T08:23:37.017727Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T08:23:37.304982Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:690)
2025-10-31T08:23:37.392086Z node 25 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:566: Compilation failed, self: [25:7567298658171504174:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-31T08:23:37.395775Z node 25 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=25&id=M2M4MDMxNC00OTEzYjkzNi05Y2NmM2M0NC1iYjIyMmE0Mg==, ActorId: [25:7567298658171504172:2309], ActorState: ExecuteState, TraceId: 01k8wntx2aava1tb7jhhpwpxgn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-31T08:23:37.396376Z node 25 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, true, 1000);
2025-10-31T08:23:37.941333Z node 24 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715665. Ctx: { TraceId: 01k8wntxap694aqd7sxrtypwsd, Database: , SessionId: ydb://session/3?node_id=24&id=OTY1ZTZkYWMtZTM3ZDU1ODQtZjRlOTMxYjYtZGEwNjYyMjk=, PoolId: , DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [24:7567298662282409455:3084] 
2025-10-31T08:23:41.864582Z node 24 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7717: Cannot get console configs
2025-10-31T08:23:41.864627Z node 24 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
=== CheckClustersList. Ok
PQ Client: create topic: rt3.dc1--topic1 with 1 partitions
CallPersQueueGRPC request to localhost:13378
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
CallPersQueueGRPC response:
2025-10-31T08:23:43.074857Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13378
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--topic1"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715671
  SchemeShardTabletId: 72057594046644480
  PathId: 9
}
ErrorCode: OK
AddTopic: rt3.dc1--topic1
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = topic1, dc = dc1
2025-10-31T08:23:43.163830Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2962: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-31T08:23:43.161330Z node 24 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [24:7567298683757246277:3281] connected; active server actors: 1
2025-10-31T08:23:43.163019Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--topic1] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-31T08:23:43.168106Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:969: [72075186224037893][rt3.dc1--topic1] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-31T08:23:43.172039Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--topic1] BALANCER INIT DONE for rt3.dc1--topic1: (0, 72075186224037892) 
2025-10-31T08:23:43.172468Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2994: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-31T08:23:43.172826Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:787: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-31T08:23:43.172881Z node 25 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T08:23:43.172927Z node 25 :PERSQUEUE INFO: pq_impl.cpp:612: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-31T08:23:43.174846Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298683757246276:3280], now have 1 active actors on pipe
2025-10-31T08:23:43.174876Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298683757246309:2439], now have 1 active actors on pipe
2025-10-31T08:23:43.178795Z node 24 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--topic1] TEvClientConnected TabletId 72075186224037892, NodeId 25, Generation 1
2025-10-31T08:23:43.178011Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:23:43.182853Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:23:43.193902Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298683757246328:3322], now have 1 active actors on pipe
2025-10-31T08:23:43.195123Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:23:43.223369Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:23:43.224737Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitConfigStep
2025-10-31T08:23:43.224800Z node 25 :PERSQUEUE DEBUG: partition.cpp:1279: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-31T08:23:43.225237Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-31T08:23:43.226095Z node 25 :PERSQUEUE INFO: partition_init.cpp:1101: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [25:7567298683941308138:2350]
2025-10-31T08:23:43.239576Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--topic1:0:Initializer] Start initializing step TInitFieldsStep
2025-10-31T08:23:43.239626Z node 25 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--topic1:0:Initializer] Initializing completed.
2025-10-31T08:23:43.239662Z node 25 :PERSQUEUE INFO: partition.cpp:696: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--topic1' partition 0 generation 1 [25:7567298683941308138:2350]
2025-10-31T08:23:43.239698Z node 25 :PERSQUEUE DEBUG: partition.cpp:710: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--topic1 partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-31T08:23:43.246644Z node 25 :PERSQUEUE DEBUG: partition.cpp:4239: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-31T08:23:43.246701Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.246832Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.246846Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:43.246868Z node 25 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T08:23:43.246883Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.246896Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.246908Z node 25 :PERSQUEUE DEBUG: partition.cpp:2285: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-31T08:23:43.246946Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T08:23:43.247799Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:23:43.247985Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:43.266333Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:23:43.266957Z node 25 :PERSQUEUE DEBUG: partition.cpp:1383: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1761899023234, TxId 281474976715671
2025-10-31T08:23:43.266983Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.266997Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.267212Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.267569Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:43.276676Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:43.277120Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:43.277151Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.277191Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.277221Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.277289Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:43.277847Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:398: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--topic1" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--topic1" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-31T08:23:43.278030Z node 25 :PERSQUEUE NOTICE: pq_impl.cpp:913: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-31T08:23:43.278719Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:23:43.315012Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:23:43.315172Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:3572: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-31T08:23:43.333746Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1045: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-31T08:23:43.353047Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.353078Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.353092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.455986Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.456018Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.456033Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.506673Z node 24 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715674. Ctx: { TraceId: 01k8wnv2sr84z82mq8gxgd5t8p, Database: , SessionId: ydb://session/3?node_id=24&id=ZWJjNDUyMGItZTE4NWFmYzEtOGJkOTNiZS01NjNjNGIwMQ==, PoolId: , DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--topic1
2025-10-31T08:23:43.556771Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
TClient::Ls response: 2025-10-31T08:23:43.556803Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.556819Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715671
    CreateStep: 1761899023234
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--topic1"
    PathId: 9
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715671
    CreateStep: 1761899023234
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--topic1"
    PathId: 9
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 8
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--topic1"
 name rt3.dc1--topic1 version1
CallPersQueueGRPC request to localhost:13378
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T08:23:43.561419Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-31T08:23:43.658218Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.658257Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.658272Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.760432Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.760466Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.760483Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.867317Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.867353Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.867369Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:43.972316Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:43.972355Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:43.972371Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13378
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T08:23:44.072623Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.072654Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.072668Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.076043Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--topic1, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-31T08:23:44.176605Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.176636Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.176653Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.277166Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.277201Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.277217Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.380087Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.380126Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.380143Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.486471Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.486502Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.486518Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13378
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--topic1"
  }
}
2025-10-31T08:23:44.586812Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.586842Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.586856Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.587842Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--topic1"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--topic1"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:44.594017Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:44.594973Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298688052213821:3437], now have 1 active actors on pipe
2025-10-31T08:23:44.595562Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:44.595604Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:44.595723Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|842adb8c-58807ae-cd13e33f-40bc99f8_0 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:44.595771Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.595797Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.595811Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:44.595862Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.595930Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:44.595998Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-10-31T08:23:44.596534Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:44.597498Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298688052213821:3437] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|842adb8c-58807ae-cd13e33f-40bc99f8_0"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|842adb8c-58807ae-cd13e33f-40bc99f8_0"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 0
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:44.688585Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.688628Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.688644Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.695590Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:44.696611Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298688052213827:3439], now have 1 active actors on pipe
2025-10-31T08:23:44.706435Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:44.706487Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:44.707510Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:44.708094Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:44.708133Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:44.708172Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 0 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:44.708627Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:44.708691Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.708723Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.708735Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:44.708875Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-10-31T08:23:44.708933Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 1
2025-10-31T08:23:44.708953Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 2
2025-10-31T08:23:44.815181Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 0 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048790 count 1 nextOffset 1 batches 3
2025-10-31T08:23:44.819774Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.821052Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00002? size 1048780 WTime 1761899024819
2025-10-31T08:23:44.822575Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:44.822603Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:44.822795Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 1048780
2025-10-31T08:23:44.849123Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:44.849197Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:44.849260Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:44.849285Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:44.849339Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 0, Offset: 0 is stored on disk
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 0
    Offset: 0
    PartNo: 0
    WriteTimestampMS: 1761899024706
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 141
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:44.851621Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:44.849358Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:44.849363Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:44.849382Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 1, Offset: 0 is stored on disk
2025-10-31T08:23:44.849408Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:44.849432Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 0, partNo: 2, Offset: 0 is stored on disk
2025-10-31T08:23:44.850133Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:911: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-31T08:23:44.850161Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:953: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-31T08:23:44.850185Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.850201Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.850215Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:44.850259Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:44.850345Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:44.850468Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-31T08:23:44.850782Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 1048780 count 1 last offset 0, current partition end offset: 1
2025-10-31T08:23:44.850805Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-31T08:23:44.850856Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:44.000000Z
2025-10-31T08:23:44.850892Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-31T08:23:44.850929Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:44.850961Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 1 blobs
2025-10-31T08:23:44.861381Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:44.863087Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:44.863272Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:44.863433Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298688052213827:3439] destroyed
2025-10-31T08:23:44.863480Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1003: Topic 'rt3.dc1--topic1' partition 0 user user readTimeStamp done, result 1761899024706 queuesize 0 startOffset 0
2025-10-31T08:23:44.927137Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:44.927179Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:44.927206Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.019908Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:45.024084Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298692347181156:3453], now have 1 active actors on pipe
2025-10-31T08:23:45.026092Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:45.026137Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:45.026297Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|de1e148c-5cee04ae-f2d3a8c9-7a6fb856_1 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:45.026339Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.026356Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.026374Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:45.026425Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.026476Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:45.026539Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:45.027844Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|de1e148c-5cee04ae-f2d3a8c9-7a6fb856_1"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:45.028070Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.028098Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.028112Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.028595Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298692347181156:3453] destroyed
2025-10-31T08:23:45.128212Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.128260Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.128277Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|de1e148c-5cee04ae-f2d3a8c9-7a6fb856_1"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 1
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:45.158653Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:45.159773Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298692347181163:3458], now have 1 active actors on pipe
2025-10-31T08:23:45.169074Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:45.169136Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:45.169768Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:45.170380Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:45.170427Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:45.170474Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 1 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:45.170963Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:45.171022Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.171052Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.171063Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:45.171213Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-10-31T08:23:45.171256Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-10-31T08:23:45.171278Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-10-31T08:23:45.344955Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1048790 count 1 nextOffset 2 batches 3
2025-10-31T08:23:45.345065Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.346171Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00002? size 1048780 WTime 1761899025344
2025-10-31T08:23:45.347527Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:45.347571Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:45.347757Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 1048780
2025-10-31T08:23:45.389334Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:45.389409Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:45.389470Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:45.389495Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:45.389540Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 0, Offset: 1 is stored on disk
2025-10-31T08:23:45.389559Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:45.389580Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 1, Offset: 1 is stored on disk
2025-10-31T08:23:45.389602Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:45.389626Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 1, partNo: 2, Offset: 1 is stored on disk
2025-10-31T08:23:45.390293Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.390313Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.390329Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.390375Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:45.390465Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:45.391189Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:45.392759Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298692347181163:3458] destroyed
2025-10-31T08:23:45.391440Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 1
    Offset: 1
    PartNo: 0
    WriteTimestampMS: 1761899025165
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 222
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:45.408040Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:45.412611Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298692347181174:3467], now have 1 active actors on pipe
2025-10-31T08:23:45.413169Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:45.413204Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:45.413327Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|958e3122-902f806a-8cde68db-af02d675_2 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:45.413365Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.413384Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.413399Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:45.413452Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.413503Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:45.413569Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:45.414098Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|958e3122-902f806a-8cde68db-af02d675_2"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:45.420359Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298692347181174:3467] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|958e3122-902f806a-8cde68db-af02d675_2"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 2
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:45.448061Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.448093Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.448109Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.530690Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:45.540697Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298692347181193:3476], now have 1 active actors on pipe
2025-10-31T08:23:45.547761Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.547796Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.547811Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.550833Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:45.550877Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:45.612688Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:45.613264Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:45.613305Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:45.613338Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 2 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:45.613592Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:45.613650Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.613681Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.613693Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:45.613853Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-10-31T08:23:45.613898Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-10-31T08:23:45.613919Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-10-31T08:23:45.833768Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 1048790 count 1 nextOffset 3 batches 3
2025-10-31T08:23:45.833875Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.834944Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00002? size 1048780 WTime 1761899025832
2025-10-31T08:23:45.848371Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:45.848416Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:45.848639Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 1048780
2025-10-31T08:23:45.879708Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:45.879796Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:45.879859Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:45.879901Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:45.879949Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 0, Offset: 2 is stored on disk
2025-10-31T08:23:45.879966Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:45.879992Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 1, Offset: 2 is stored on disk
2025-10-31T08:23:45.880015Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:45.880038Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 2, partNo: 2, Offset: 2 is stored on disk
2025-10-31T08:23:45.880474Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.880492Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.880506Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.880554Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:45.880647Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:45.881235Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:45.884190Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 2
    Offset: 2
    PartNo: 0
    WriteTimestampMS: 1761899025612
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 265
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:45.888015Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298692347181193:3476] destroyed
2025-10-31T08:23:45.894696Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:45.901825Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:45.900600Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298692347181206:3485], now have 1 active actors on pipe
2025-10-31T08:23:45.901120Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:45.901153Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:45.901286Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d87e6564-2e9bd4b0-e4929595-4b6c44c8_3 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:45.901325Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.901343Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.901358Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:45.901425Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.901474Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:45.901544Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:45.903059Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298692347181206:3485] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d87e6564-2e9bd4b0-e4929595-4b6c44c8_3"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d87e6564-2e9bd4b0-e4929595-4b6c44c8_3"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 3
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:45.956017Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.956058Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.956075Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:45.965265Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:45.972684Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298692347181211:3489], now have 1 active actors on pipe
2025-10-31T08:23:45.980543Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:45.980600Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:45.981161Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:45.981651Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:45.981747Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:45.981784Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 3 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:45.982243Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:45.982304Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:45.982336Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:45.982347Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:45.982500Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-10-31T08:23:45.982566Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-10-31T08:23:45.982593Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-10-31T08:23:46.033375Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 1048790 count 1 nextOffset 4 batches 3
2025-10-31T08:23:46.033472Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.034502Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00002? size 1048780 WTime 1761899026032
2025-10-31T08:23:46.045123Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:46.045342Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 1048780
2025-10-31T08:23:46.057128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:46.070017Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:46.070102Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:46.070162Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:46.070187Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.070236Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 0, Offset: 3 is stored on disk
2025-10-31T08:23:46.070252Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.070275Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 1, Offset: 3 is stored on disk
2025-10-31T08:23:46.070297Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.070338Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 3, partNo: 2, Offset: 3 is stored on disk
2025-10-31T08:23:46.071014Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.071038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.071056Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.071107Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:46.071201Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:46.071823Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:46.072115Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:46.077864Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298692347181211:3489] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 3
    Offset: 3
    PartNo: 0
    WriteTimestampMS: 1761899025982
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 85
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:46.082694Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:46.083767Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298696642148517:3496], now have 1 active actors on pipe
2025-10-31T08:23:46.088336Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:46.088398Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:46.088543Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|5eccbb95-cac51375-1d8af45d-24fed2de_4 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:46.088583Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.088604Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.088620Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:46.088679Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.088730Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:46.088803Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:46.089486Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:46.090919Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298696642148517:3496] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|5eccbb95-cac51375-1d8af45d-24fed2de_4"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|5eccbb95-cac51375-1d8af45d-24fed2de_4"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 4
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:46.152198Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:46.160502Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.160546Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.160567Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.164045Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298696642148522:3497], now have 1 active actors on pipe
2025-10-31T08:23:46.176480Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:46.176540Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:46.177094Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:46.177622Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:46.177721Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:46.177755Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 4 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:46.178454Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:46.178526Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.178557Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.178569Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:46.178720Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-10-31T08:23:46.178764Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-10-31T08:23:46.178783Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-10-31T08:23:46.182830Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 1048790 count 1 nextOffset 5 batches 3
2025-10-31T08:23:46.192038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.193106Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 4,1 HeadOffset 4 endOffset 4 curOffset 5 d0000000000_00000000000000000004_00000_0000000001_00002? size 1048780 WTime 1761899026192
2025-10-31T08:23:46.194325Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:46.194538Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 1 size 1048780
2025-10-31T08:23:46.214694Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:46.214781Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:46.214839Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:46.214862Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.214917Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 0, Offset: 4 is stored on disk
2025-10-31T08:23:46.214941Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.214966Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 1, Offset: 4 is stored on disk
2025-10-31T08:23:46.214989Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.215013Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 4, partNo: 2, Offset: 4 is stored on disk
2025-10-31T08:23:46.215666Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.215683Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.215698Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.215742Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:46.215834Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:46.216261Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:46.216499Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 4
    Offset: 4
    PartNo: 0
    WriteTimestampMS: 1761899026175
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 36
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:46.228047Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:46.230590Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bd4b8494-96fc7507-b2180b1c-19fc4a_5"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:46.229339Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298696642148537:3506], now have 1 active actors on pipe
2025-10-31T08:23:46.229810Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:46.229842Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:46.229978Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bd4b8494-96fc7507-b2180b1c-19fc4a_5 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:46.230017Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.230036Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.230050Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:46.230105Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.230158Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:46.230225Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:46.231968Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298696642148537:3506] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|bd4b8494-96fc7507-b2180b1c-19fc4a_5"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 5
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:46.264278Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.264313Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.264328Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.266414Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:46.272926Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298696642148540:3507], now have 1 active actors on pipe
2025-10-31T08:23:46.278465Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:46.278529Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:46.279072Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:46.279597Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:46.279640Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:46.279679Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 5 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:46.280652Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:46.280725Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.280756Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.280768Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:46.280916Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-10-31T08:23:46.280963Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-10-31T08:23:46.280982Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-10-31T08:23:46.338883Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 1048790 count 1 nextOffset 6 batches 3
2025-10-31T08:23:46.338979Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.340261Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 5,1 HeadOffset 5 endOffset 5 curOffset 6 d0000000000_00000000000000000005_00000_0000000001_00002? size 1048780 WTime 1761899026339
2025-10-31T08:23:46.341576Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298696642148522:3497] destroyed
2025-10-31T08:23:46.341611Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:46.341796Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 1 size 1048780
2025-10-31T08:23:46.368794Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:46.385544Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:46.385624Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:46.385685Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:46.385730Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.385779Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 0, Offset: 5 is stored on disk
2025-10-31T08:23:46.385795Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.385818Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 1, Offset: 5 is stored on disk
2025-10-31T08:23:46.385842Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:46.385865Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 5, partNo: 2, Offset: 5 is stored on disk
2025-10-31T08:23:46.386433Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.386450Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.386465Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.386509Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:46.386601Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:46.387374Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:46.387496Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 5
    Offset: 5
    PartNo: 0
    WriteTimestampMS: 1761899026280
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 104
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:46.393156Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298696642148540:3507] destroyed
2025-10-31T08:23:46.472162Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.472199Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.472216Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.580042Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.580080Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.580095Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.684057Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.684097Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.684114Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.788010Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.788050Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.788065Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:46.893730Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:46.893768Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:46.893782Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.000640Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.000680Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.000696Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.006903Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:47.099204Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.099243Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.099259Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.201141Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.201179Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.201198Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.276988Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037890 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 7] state 'Ready' dataSize 0 rowCount 0 cpuUsage 0
2025-10-31T08:23:47.308084Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.308132Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.308152Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.377115Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-10-31T08:23:47.377274Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 7 shard idx 72057594046644480:3 data size 0 row count 0
2025-10-31T08:23:47.377379Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037890 maps to shardIdx: 72057594046644480:3 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 7], pathId map=Topics, is column=0, is olap=0, RowCount 0, DataSize 0
2025-10-31T08:23:47.377488Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037890 SplitByLoadNotEnabledForTable
2025-10-31T08:23:47.378097Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:47.409723Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.409764Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.409781Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.516020Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.516063Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.516080Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.617580Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.617613Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.617631Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.717988Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.718022Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.718038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.822382Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.822417Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.822434Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:47.920604Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:47.920639Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:47.920655Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.028049Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.028084Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.028099Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.128315Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.128350Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.128369Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.232306Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.232357Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.232374Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.252383Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:48.334527Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.334566Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.334582Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.360257Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037888 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 3] state 'Ready' dataSize 0 rowCount 0 cpuUsage 0.1167
2025-10-31T08:23:48.435817Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.435850Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.435868Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.460768Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-10-31T08:23:48.460955Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 3 shard idx 72057594046644480:1 data size 0 row count 0
2025-10-31T08:23:48.461057Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037888 maps to shardIdx: 72057594046644480:1 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 3], pathId map=SourceIdMeta2, is column=0, is olap=0, RowCount 0, DataSize 0
2025-10-31T08:23:48.461175Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037888 SplitByLoadNotEnabledForTable
2025-10-31T08:23:48.461331Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:48.536250Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.536285Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.536304Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.636591Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.636632Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.636648Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.740389Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.740429Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.740445Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.844635Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.844670Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.844688Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.925115Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298705232083188:3526], now have 1 active actors on pipe
2025-10-31T08:23:48.928909Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:48.928966Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:48.929112Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|4a52b92c-df36261a-bc4a249f-8494b69e_6 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:48.929154Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.929174Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.929189Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:48.929243Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.929295Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:48.929370Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:48.929994Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-31T08:23:48.930968Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298705232083188:3526] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|4a52b92c-df36261a-bc4a249f-8494b69e_6"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:48.948542Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:48.948585Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:48.948602Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:48.950460Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037889 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 6] state 'Ready' dataSize 824 rowCount 2 cpuUsage 0
2025-10-31T08:23:48.950517Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037891 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 8] state 'Ready' dataSize 656 rowCount 2 cpuUsage 0
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|4a52b92c-df36261a-bc4a249f-8494b69e_6"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 6
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.021678Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.022536Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050523:3553], now have 1 active actors on pipe
2025-10-31T08:23:49.028019Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.028077Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.028641Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.029162Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.029242Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.029278Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 6 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.029509Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.029567Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.029595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.029608Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.029778Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-10-31T08:23:49.029825Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-10-31T08:23:49.029844Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-10-31T08:23:49.051584Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 2
2025-10-31T08:23:49.051743Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 6 shard idx 72057594046644480:2 data size 824 row count 2
2025-10-31T08:23:49.051849Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037889 maps to shardIdx: 72057594046644480:2 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 6], pathId map=Cluster, is column=0, is olap=0, RowCount 2, DataSize 824
2025-10-31T08:23:49.051985Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037889 SplitByLoadNotEnabledForTable
2025-10-31T08:23:49.052055Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 8 shard idx 72057594046644480:4 data size 656 row count 2
2025-10-31T08:23:49.052091Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037891 maps to shardIdx: 72057594046644480:4 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 8], pathId map=Versions, is column=0, is olap=0, RowCount 2, DataSize 656
2025-10-31T08:23:49.052132Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037891 SplitByLoadNotEnabledForTable
2025-10-31T08:23:49.052588Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:49.056807Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 1048790 count 1 nextOffset 7 batches 3
2025-10-31T08:23:49.056902Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.057992Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00002? size 1048780 WTime 1761899029055
2025-10-31T08:23:49.059213Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:49.059246Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.059443Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.071197Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.071292Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.071355Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.071381Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.071438Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 0, Offset: 6 is stored on disk
2025-10-31T08:23:49.071461Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.071485Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 1, Offset: 6 is stored on disk
2025-10-31T08:23:49.071508Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.071534Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 6, partNo: 2, Offset: 6 is stored on disk
2025-10-31T08:23:49.072058Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.072089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.072105Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.072164Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.072240Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--topic1' counters. CacheSize 7341460 CachedBlobs 7
2025-10-31T08:23:49.072318Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.072976Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.073180Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 6
    Offset: 6
    PartNo: 0
    WriteTimestampMS: 1761899029026
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 38
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.077655Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050523:3553] destroyed
2025-10-31T08:23:49.078927Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.082927Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050527:3556], now have 1 active actors on pipe
2025-10-31T08:23:49.083025Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.083057Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.083199Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|148de3af-ce17dd32-b99f406c-3725a691_7 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.083250Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.083270Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.083293Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.083352Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.083403Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.083475Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.084895Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|148de3af-ce17dd32-b99f406c-3725a691_7"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:49.086407Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050527:3556] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|148de3af-ce17dd32-b99f406c-3725a691_7"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 7
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.124109Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.125614Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050534:3559], now have 1 active actors on pipe
2025-10-31T08:23:49.131103Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.131165Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.131710Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.132232Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.132268Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.132303Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 7 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.132577Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.132635Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.132664Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.132677Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.132837Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-10-31T08:23:49.132880Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-10-31T08:23:49.132898Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-10-31T08:23:49.140995Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 7 partNo 2 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 1048790 count 1 nextOffset 8 batches 3
2025-10-31T08:23:49.141089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.142447Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 7 endOffset 7 curOffset 8 d0000000000_00000000000000000007_00000_0000000001_00002? size 1048780 WTime 1761899029140
2025-10-31T08:23:49.145149Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.145418Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.159952Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:49.164780Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-31T08:23:49.160275Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.160349Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.160410Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.160438Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 7
    Offset: 7
    PartNo: 0
    WriteTimestampMS: 1761899029131
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 28
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-10-31T08:23:49.160495Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 0, Offset: 7 is stored on disk
2025-10-31T08:23:49.160513Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.160540Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 1, Offset: 7 is stored on disk
2025-10-31T08:23:49.160565Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.160591Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 7, partNo: 2, Offset: 7 is stored on disk
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:49.161095Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.161114Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.161164Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.161219Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161234Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161250Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161265Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161280Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161295Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161309Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161323Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000001_00002? (1048780)
2025-10-31T08:23:49.161336Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-10-31T08:23:49.161443Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.161501Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-10-31T08:23:49.161528Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00002?
2025-10-31T08:23:49.161755Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00002?
2025-10-31T08:23:49.162004Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00002?
2025-10-31T08:23:49.162282Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00002?
2025-10-31T08:23:49.162466Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000001_00002?
2025-10-31T08:23:49.162876Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000001_00002?
2025-10-31T08:23:49.162995Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00002?
2025-10-31T08:23:49.163104Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000001_00002?
2025-10-31T08:23:49.163217Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-10-31T08:23:49.163277Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 1 times before, last time 2025-10-31T08:23:44.000000Z
2025-10-31T08:23:49.163336Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:45.000000Z
2025-10-31T08:23:49.163356Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:45.000000Z
2025-10-31T08:23:49.163374Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:46.000000Z
2025-10-31T08:23:49.163395Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:46.000000Z
2025-10-31T08:23:49.163414Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:46.000000Z
2025-10-31T08:23:49.163434Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:49.163456Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:49.163495Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-10-31T08:23:49.163600Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-31T08:23:49.163646Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000000_00000_0000000001_00002?
2025-10-31T08:23:49.163660Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.163685Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000000_00000_0000000001_00002?, parameters.CurOffset=0
2025-10-31T08:23:49.164022Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.164101Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164129Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164154Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164181Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164207Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164233Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164258Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.164282Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:49.168789Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.0/3
2025-10-31T08:23:49.168873Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 0
2025-10-31T08:23:49.168904Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:0 appended
2025-10-31T08:23:49.170158Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.1/3
2025-10-31T08:23:49.170202Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 1
2025-10-31T08:23:49.170223Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:1 appended
2025-10-31T08:23:49.169844Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.170468Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 0.2/3
2025-10-31T08:23:49.170494Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 0 partNo 2
2025-10-31T08:23:49.208988Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 0 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1048790 count 1 nextOffset 1 batches 3
2025-10-31T08:23:49.209062Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 0:2 appended
2025-10-31T08:23:49.209110Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000001_00000_0000000001_00002?
2025-10-31T08:23:49.209126Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.209154Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000001_00000_0000000001_00002?, parameters.CurOffset=1
2025-10-31T08:23:49.210254Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.0/3
2025-10-31T08:23:49.210313Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 0
2025-10-31T08:23:49.210332Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:0 appended
2025-10-31T08:23:49.211484Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.1/3
2025-10-31T08:23:49.211522Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 1
2025-10-31T08:23:49.211539Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:1 appended
2025-10-31T08:23:49.211709Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 1.2/3
2025-10-31T08:23:49.211727Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 1 partNo 2
2025-10-31T08:23:49.295160Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 1 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2097546 count 2 nextOffset 2 batches 5
2025-10-31T08:23:49.295240Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 1:2 appended
2025-10-31T08:23:49.295318Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000002_00000_0000000001_00002?
2025-10-31T08:23:49.295351Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.295399Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000002_00000_0000000001_00002?, parameters.CurOffset=2
2025-10-31T08:23:49.296670Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.0/3
2025-10-31T08:23:49.296736Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 0
2025-10-31T08:23:49.296756Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:0 appended
2025-10-31T08:23:49.297788Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.1/3
2025-10-31T08:23:49.297817Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 1
2025-10-31T08:23:49.297836Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:1 appended
2025-10-31T08:23:49.297965Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 2.2/3
2025-10-31T08:23:49.297982Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 2 partNo 2
2025-10-31T08:23:49.320452Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 2 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 3146302 count 3 nextOffset 3 batches 7
2025-10-31T08:23:49.320533Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 2:2 appended
2025-10-31T08:23:49.320582Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000003_00000_0000000001_00002?
2025-10-31T08:23:49.320597Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.320624Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000003_00000_0000000001_00002?, parameters.CurOffset=3
2025-10-31T08:23:49.321486Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.0/3
2025-10-31T08:23:49.321526Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 0
2025-10-31T08:23:49.321543Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:0 appended
2025-10-31T08:23:49.322464Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.1/3
2025-10-31T08:23:49.322488Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 1
2025-10-31T08:23:49.322502Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:1 appended
2025-10-31T08:23:49.322624Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 3.2/3
2025-10-31T08:23:49.322643Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 3 partNo 2
2025-10-31T08:23:49.325945Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 3 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4195058 count 4 nextOffset 4 batches 9
2025-10-31T08:23:49.326008Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 3:2 appended
2025-10-31T08:23:49.326051Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000004_00000_0000000001_00002?
2025-10-31T08:23:49.326068Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.326095Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000004_00000_0000000001_00002?, parameters.CurOffset=4
2025-10-31T08:23:49.327038Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.0/3
2025-10-31T08:23:49.327075Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 0
2025-10-31T08:23:49.327092Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:0 appended
2025-10-31T08:23:49.328471Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.1/3
2025-10-31T08:23:49.328510Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 1
2025-10-31T08:23:49.328526Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:1 appended
2025-10-31T08:23:49.328663Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 4.2/3
2025-10-31T08:23:49.328680Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 4 partNo 2
2025-10-31T08:23:49.355017Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 4 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 5243814 count 5 nextOffset 5 batches 11
2025-10-31T08:23:49.355093Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 4:2 appended
2025-10-31T08:23:49.355138Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000005_00000_0000000001_00002?
2025-10-31T08:23:49.355153Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.355180Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000005_00000_0000000001_00002?, parameters.CurOffset=5
2025-10-31T08:23:49.356449Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.0/3
2025-10-31T08:23:49.356497Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 0
2025-10-31T08:23:49.356517Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:0 appended
2025-10-31T08:23:49.357571Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.1/3
2025-10-31T08:23:49.357595Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 1
2025-10-31T08:23:49.357611Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:1 appended
2025-10-31T08:23:49.357776Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 5.2/3
2025-10-31T08:23:49.357792Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 5 partNo 2
2025-10-31T08:23:49.374555Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 5 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6292569 count 6 nextOffset 6 batches 13
2025-10-31T08:23:49.374640Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 5:2 appended
2025-10-31T08:23:49.374685Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000006_00000_0000000001_00002?
2025-10-31T08:23:49.374700Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.374727Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000006_00000_0000000001_00002?, parameters.CurOffset=6
2025-10-31T08:23:49.375690Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.0/3
2025-10-31T08:23:49.375732Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 0
2025-10-31T08:23:49.375749Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:0 appended
2025-10-31T08:23:49.377816Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.1/3
2025-10-31T08:23:49.377864Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 1
2025-10-31T08:23:49.377880Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:1 appended
2025-10-31T08:23:49.378028Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 6.2/3
2025-10-31T08:23:49.378055Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 6 partNo 2
2025-10-31T08:23:49.380837Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 6 partNo 2 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 7341325 count 7 nextOffset 7 batches 15
2025-10-31T08:23:49.380880Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 6:2 appended
2025-10-31T08:23:49.380919Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000007_00000_0000000001_00002?
2025-10-31T08:23:49.380934Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:49.380960Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000007_00000_0000000001_00002?, parameters.CurOffset=7
2025-10-31T08:23:49.381933Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.0/3
2025-10-31T08:23:49.381968Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 0
2025-10-31T08:23:49.381983Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:0 appended
2025-10-31T08:23:49.382996Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.1/3
2025-10-31T08:23:49.383020Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 1
2025-10-31T08:23:49.383035Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:1 appended
2025-10-31T08:23:49.383187Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 7.2/3
2025-10-31T08:23:49.383203Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 7 partNo 2
2025-10-31T08:23:49.467119Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 7 partNo 2 result is x0000000000_00000000000000000000_00000_0000000007_00016 size 8365344
2025-10-31T08:23:49.467225Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000000_00000_0000000007_00016 new key d0000000000_00000000000000000000_00000_0000000007_00016 size 8365344 WTime 1761899029463
2025-10-31T08:23:49.472480Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 7 partNo 2 FormedBlobsCount 1 NewHead: Offset 7 PartNo 2 PackedSize 24736 count 1 nextOffset 8 batches 1
2025-10-31T08:23:49.472545Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 7:2 appended
2025-10-31T08:23:49.473448Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 7,1 HeadOffset 0 endOffset 0 curOffset 8 d0000000000_00000000000000000007_00002_0000000001_00000| size 24726 WTime 1761899029471
2025-10-31T08:23:49.473728Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050534:3559] destroyed
2025-10-31T08:23:49.473788Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050539:3563], now have 1 active actors on pipe
2025-10-31T08:23:49.473864Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.473893Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.473962Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.473976Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.473991Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.474067Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.474263Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 7 size 8365344
2025-10-31T08:23:49.474380Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 2 count 1 size 24726
2025-10-31T08:23:49.474511Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|eecd33f8-8b0bafca-3d997333-b361eb21_8 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.474541Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.474558Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.474571Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.474618Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.474659Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.474852Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|eecd33f8-8b0bafca-3d997333-b361eb21_8"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:49.476230Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.492283Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050539:3563] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|eecd33f8-8b0bafca-3d997333-b361eb21_8"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 8
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.524509Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.525534Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050549:3571], now have 1 active actors on pipe
2025-10-31T08:23:49.530241Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.530297Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.530792Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.531291Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.531339Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.531371Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 8 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.532933Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.532998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.533027Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.533038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.533167Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-10-31T08:23:49.533208Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-10-31T08:23:49.533234Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-10-31T08:23:49.536476Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-10-31T08:23:49.536555Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.537703Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 8,1 HeadOffset 8 endOffset 8 curOffset 9 d0000000000_00000000000000000008_00000_0000000001_00002? size 1048780 WTime 1761899029536
2025-10-31T08:23:49.538759Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 7 size 8365344 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.538789Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 24726 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.538884Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.538933Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365344
2025-10-31T08:23:49.538981Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 1 parts 0 suffix '124' size 24726
2025-10-31T08:23:49.539071Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.539119Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.539423Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:49.539443Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.556296Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.556381Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.556443Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.556469Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.556518Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 0, Offset: 8 is stored on disk
2025-10-31T08:23:49.556534Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.556549Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.558112Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.556562Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 1, Offset: 8 is stored on disk
2025-10-31T08:23:49.556585Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.556608Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 8, partNo: 2, Offset: 8 is stored on disk
2025-10-31T08:23:49.557137Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.557157Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.557173Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.557418Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.557521Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.557580Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.557616Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00002?(+) to d0000000000_00000000000000000000_00000_0000000001_00002?(+)
2025-10-31T08:23:49.557627Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00002?(+) to d0000000000_00000000000000000001_00000_0000000001_00002?(+)
2025-10-31T08:23:49.557638Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00002?(+) to d0000000000_00000000000000000002_00000_0000000001_00002?(+)
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 8
    Offset: 8
    PartNo: 0
    WriteTimestampMS: 1761899029531
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.557649Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00002?(+) to d0000000000_00000000000000000003_00000_0000000001_00002?(+)
2025-10-31T08:23:49.557658Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000001_00002?(+) to d0000000000_00000000000000000004_00000_0000000001_00002?(+)
2025-10-31T08:23:49.557669Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000001_00002?(+) to d0000000000_00000000000000000005_00000_0000000001_00002?(+)
2025-10-31T08:23:49.557693Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00002?(+) to d0000000000_00000000000000000006_00000_0000000001_00002?(+)
2025-10-31T08:23:49.557705Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000001_00002?(+) to d0000000000_00000000000000000007_00000_0000000001_00002?(+)
2025-10-31T08:23:49.559539Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050549:3571] destroyed
2025-10-31T08:23:49.565174Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.568993Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050557:3578], now have 1 active actors on pipe
2025-10-31T08:23:49.569145Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569188Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569231Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569266Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569307Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569343Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569379Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569414Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.569503Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.569559Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.569590Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.569611Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.569626Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.569672Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.569832Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.570177Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.570499Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.570622Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.570682Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.570839Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.570881Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|856b2c1b-87f4b48d-6f34ad63-22dd6e08_9 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.570944Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.570981Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.571013Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.571137Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.571180Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.571184Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.571432Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.571588Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.572343Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.572358Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.572372Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.571938Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|856b2c1b-87f4b48d-6f34ad63-22dd6e08_9"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|856b2c1b-87f4b48d-6f34ad63-22dd6e08_9"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 9
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.573002Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050557:3578] destroyed
2025-10-31T08:23:49.573361Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.573672Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.599872Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.601779Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050561:3581], now have 1 active actors on pipe
2025-10-31T08:23:49.607110Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.607171Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.607814Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.608308Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.608357Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.608392Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 9 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.609377Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.609433Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.609461Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.609474Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.609623Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-10-31T08:23:49.609667Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-10-31T08:23:49.609700Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-10-31T08:23:49.615208Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 1048790 count 1 nextOffset 10 batches 3
2025-10-31T08:23:49.615291Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.616492Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00002? size 1048780 WTime 1761899029615
2025-10-31T08:23:49.617615Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.617830Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.638597Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.637321Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.637400Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.637458Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.637485Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.637536Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 0, Offset: 9 is stored on disk
2025-10-31T08:23:49.637554Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.637579Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 1, Offset: 9 is stored on disk
2025-10-31T08:23:49.637602Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.637625Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 9, partNo: 2, Offset: 9 is stored on disk
2025-10-31T08:23:49.638082Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.638099Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.638114Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.638162Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.638258Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.638406Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.639958Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050561:3581] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 9
    Offset: 9
    PartNo: 0
    WriteTimestampMS: 1761899029608
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 29
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.645845Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.646632Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050567:3586], now have 1 active actors on pipe
2025-10-31T08:23:49.647070Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.647103Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.647232Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f8b4c8ef-71ab80bd-93c3b64e-3dc9a40d_10 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.647270Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.647291Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.647306Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.647362Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.647410Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.647478Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.647767Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f8b4c8ef-71ab80bd-93c3b64e-3dc9a40d_10"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:49.648811Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050567:3586] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f8b4c8ef-71ab80bd-93c3b64e-3dc9a40d_10"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 10
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.680221Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.680260Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.680278Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.682631Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.683552Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050572:3587], now have 1 active actors on pipe
2025-10-31T08:23:49.688619Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.688664Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.689208Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.689653Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.689704Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.689738Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 10 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.689971Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.690029Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.690060Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.690072Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.690223Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-10-31T08:23:49.690270Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-10-31T08:23:49.690290Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-10-31T08:23:49.697302Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 1048790 count 1 nextOffset 11 batches 3
2025-10-31T08:23:49.697397Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.698538Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00002? size 1048780 WTime 1761899029698
2025-10-31T08:23:49.699698Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.700097Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.713221Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.713303Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.713362Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.713389Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.713443Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 0, Offset: 10 is stored on disk
2025-10-31T08:23:49.713460Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.713484Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 1, Offset: 10 is stored on disk
2025-10-31T08:23:49.713508Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.713532Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 10, partNo: 2, Offset: 10 is stored on disk
2025-10-31T08:23:49.714159Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.714180Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.714198Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.714244Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.714342Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.714908Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.715283Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-31T08:23:49.717144Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050572:3587] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 10
    Offset: 10
    PartNo: 0
    WriteTimestampMS: 1761899029687
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.719033Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.720233Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050576:3590], now have 1 active actors on pipe
2025-10-31T08:23:49.720324Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.720355Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.720487Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f5a97a31-a03ea829-3852cf8c-f59d53ac_11 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.720525Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.720557Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.720574Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.720627Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.720672Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.720739Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.721457Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.722875Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050576:3590] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f5a97a31-a03ea829-3852cf8c-f59d53ac_11"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f5a97a31-a03ea829-3852cf8c-f59d53ac_11"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 11
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.753577Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.755184Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050578:3591], now have 1 active actors on pipe
2025-10-31T08:23:49.760983Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.761044Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.761592Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.762125Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.762165Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.762203Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 11 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.762433Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.762489Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.762522Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.762533Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.762698Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-10-31T08:23:49.762745Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-10-31T08:23:49.762764Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-10-31T08:23:49.768566Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 1048790 count 1 nextOffset 12 batches 3
2025-10-31T08:23:49.768651Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.770266Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 11,1 HeadOffset 11 endOffset 11 curOffset 12 d0000000000_00000000000000000011_00000_0000000001_00002? size 1048780 WTime 1761899029766
2025-10-31T08:23:49.771433Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.771632Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.779307Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:49.783001Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.783078Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.783140Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.783165Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.783214Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 0, Offset: 11 is stored on disk
2025-10-31T08:23:49.783229Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.783255Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 1, Offset: 11 is stored on disk
2025-10-31T08:23:49.783278Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.783301Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 11, partNo: 2, Offset: 11 is stored on disk
2025-10-31T08:23:49.783748Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.783768Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.783783Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.783828Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.783944Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.784669Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.784460Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.786209Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050578:3591] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 11
    Offset: 11
    PartNo: 0
    WriteTimestampMS: 1761899029761
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 16
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.791622Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.792858Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050584:3596], now have 1 active actors on pipe
2025-10-31T08:23:49.792936Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.792968Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.793095Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8d0fa5fb-ae272281-f7dd3c03-ad01acb6_12 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.793132Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.793151Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.793166Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.793220Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.793266Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.793332Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.793845Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.795730Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050584:3596] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8d0fa5fb-ae272281-f7dd3c03-ad01acb6_12"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|8d0fa5fb-ae272281-f7dd3c03-ad01acb6_12"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 12
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.822197Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.823143Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050587:3598], now have 1 active actors on pipe
2025-10-31T08:23:49.828238Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.828297Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.828851Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.829357Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.829391Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.829425Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 12 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.829675Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.829747Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.829778Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.829789Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.829941Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-10-31T08:23:49.829987Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-10-31T08:23:49.830006Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-10-31T08:23:49.834365Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 12 PartNo 0 PackedSize 1048790 count 1 nextOffset 13 batches 3
2025-10-31T08:23:49.834448Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.835600Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 12,1 HeadOffset 12 endOffset 12 curOffset 13 d0000000000_00000000000000000012_00000_0000000001_00002? size 1048780 WTime 1761899029831
2025-10-31T08:23:49.836993Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.837200Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 12 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.870361Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 12 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.870445Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.870504Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.870532Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.870586Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 0, Offset: 12 is stored on disk
2025-10-31T08:23:49.870604Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.870628Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 1, Offset: 12 is stored on disk
2025-10-31T08:23:49.870653Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.870679Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 12, partNo: 2, Offset: 12 is stored on disk
2025-10-31T08:23:49.871162Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.871183Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.871200Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.871247Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.871348Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.872095Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.872339Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 12
    Offset: 12
    PartNo: 0
    WriteTimestampMS: 1761899029827
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 40
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:49.876489Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050587:3598] destroyed
2025-10-31T08:23:49.884201Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.884222Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.884238Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.892945Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.893801Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050591:3601], now have 1 active actors on pipe
2025-10-31T08:23:49.898848Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.898900Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.899045Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ac18b414-bc6e0c65-76aece7-fa66634e_13 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:49.899086Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.899107Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.899123Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:49.899182Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.899234Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:49.899307Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.904444Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.905735Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050591:3601] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ac18b414-bc6e0c65-76aece7-fa66634e_13"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ac18b414-bc6e0c65-76aece7-fa66634e_13"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 13
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:49.944066Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:49.948648Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298709527050596:3604], now have 1 active actors on pipe
2025-10-31T08:23:49.950354Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:49.950394Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:49.950958Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:49.951466Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:49.951503Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:49.951540Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 13 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:49.954988Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:49.955068Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.955099Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.955111Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:49.956691Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-10-31T08:23:49.956745Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-10-31T08:23:49.956765Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-10-31T08:23:49.960232Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 1048790 count 1 nextOffset 14 batches 3
2025-10-31T08:23:49.960309Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.961495Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00002? size 1048780 WTime 1761899029960
2025-10-31T08:23:49.962593Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:49.962781Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 1048780
2025-10-31T08:23:49.985245Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:49.985351Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:49.985413Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:49.985443Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.985494Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 0, Offset: 13 is stored on disk
2025-10-31T08:23:49.985513Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.985537Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 1, Offset: 13 is stored on disk
2025-10-31T08:23:49.985563Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:49.985589Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 13, partNo: 2, Offset: 13 is stored on disk
2025-10-31T08:23:49.986255Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.986273Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.986290Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.986336Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:49.986429Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:49.987313Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:49.987063Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:49.989444Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:49.989468Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:49.989485Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:49.989555Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298709527050596:3604] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 13
    Offset: 13
    PartNo: 0
    WriteTimestampMS: 1761899029952
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 4
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.005115Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017916:3617], now have 1 active actors on pipe
2025-10-31T08:23:50.005668Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.005727Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.005854Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|f3abe65f-e261bf66-86107f48-4608e057_14 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.005894Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.005913Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.005927Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.005981Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.006033Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.006104Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.007459Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017916:3617] destroyed
2025-10-31T08:23:50.004369Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.006556Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|f3abe65f-e261bf66-86107f48-4608e057_14"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|f3abe65f-e261bf66-86107f48-4608e057_14"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 14
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.047494Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.049730Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017918:3618], now have 1 active actors on pipe
2025-10-31T08:23:50.054375Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.054443Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.054939Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.055390Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.055427Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.055459Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 14 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.055952Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.056010Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.056038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.056049Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.056202Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-10-31T08:23:50.056257Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-10-31T08:23:50.056278Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-10-31T08:23:50.065993Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 1048790 count 1 nextOffset 15 batches 3
2025-10-31T08:23:50.066084Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.067178Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 14,1 HeadOffset 14 endOffset 14 curOffset 15 d0000000000_00000000000000000014_00000_0000000001_00002? size 1048780 WTime 1761899030067
2025-10-31T08:23:50.068540Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.068739Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.089311Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.089394Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.089460Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.089489Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.089538Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 0, Offset: 14 is stored on disk
2025-10-31T08:23:50.089556Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.089581Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 1, Offset: 14 is stored on disk
2025-10-31T08:23:50.089602Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.089627Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 14, partNo: 2, Offset: 14 is stored on disk
2025-10-31T08:23:50.090310Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.090330Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.090346Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.090839Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 14
    Offset: 14
    PartNo: 0
    WriteTimestampMS: 1761899030056
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 4
    WriteTimeMs: 32
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.090390Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.090490Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.090643Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.092523Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.092546Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.092561Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.094322Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017918:3618] destroyed
2025-10-31T08:23:50.096958Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.098057Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017922:3621], now have 1 active actors on pipe
2025-10-31T08:23:50.098127Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.098155Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.098282Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|575fa0f2-ae02bcf-a17f6a60-5fb42b_15 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.098319Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.098338Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.098353Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.098408Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.098462Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.098528Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.098762Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|575fa0f2-ae02bcf-a17f6a60-5fb42b_15"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:50.099704Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017922:3621] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|575fa0f2-ae02bcf-a17f6a60-5fb42b_15"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 15
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.152075Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.152982Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017938:3629], now have 1 active actors on pipe
2025-10-31T08:23:50.157909Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.157971Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.158487Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.158960Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.159011Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.159044Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 15 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.159498Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.159554Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.159584Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.159595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.159737Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-10-31T08:23:50.159782Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-10-31T08:23:50.159801Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-10-31T08:23:50.166217Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 15 partNo 2 FormedBlobsCount 0 NewHead: Offset 15 PartNo 0 PackedSize 1048790 count 1 nextOffset 16 batches 3
2025-10-31T08:23:50.166301Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.167397Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 15 endOffset 15 curOffset 16 d0000000000_00000000000000000015_00000_0000000001_00002? size 1048780 WTime 1761899030167
2025-10-31T08:23:50.169142Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.169345Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.197507Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:50.205458Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.205538Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.205597Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.205622Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.205668Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 0, Offset: 15 is stored on disk
2025-10-31T08:23:50.205702Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.205725Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 1, Offset: 15 is stored on disk
2025-10-31T08:23:50.205749Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.205772Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 15, partNo: 2, Offset: 15 is stored on disk
2025-10-31T08:23:50.206384Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.206403Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.206418Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.206470Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206486Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000009_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206503Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206518Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206535Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000012_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206549Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206564Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206576Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000015_00000_0000000001_00002? (1048780)
2025-10-31T08:23:50.206589Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-10-31T08:23:50.206695Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.206764Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-10-31T08:23:50.206789Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000001_00002?
2025-10-31T08:23:50.206969Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000009_00000_0000000001_00002?
2025-10-31T08:23:50.207135Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000001_00002?
2025-10-31T08:23:50.207320Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000001_00002?
2025-10-31T08:23:50.207465Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000012_00000_0000000001_00002?
2025-10-31T08:23:50.207718Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000001_00002?
2025-10-31T08:23:50.207832Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000001_00002?
2025-10-31T08:23:50.207964Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000015_00000_0000000001_00002?
2025-10-31T08:23:50.208076Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-10-31T08:23:50.208133Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:50.208155Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:50.208179Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:50.208198Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:50.208219Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 12 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:50.208240Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:49.000000Z
2025-10-31T08:23:50.208263Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:50.208284Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:50.208325Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-10-31T08:23:50.208425Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-31T08:23:50.208474Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000008_00000_0000000001_00002?
2025-10-31T08:23:50.208490Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.208514Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000008_00000_0000000001_00002?, parameters.CurOffset=8
2025-10-31T08:23:50.209490Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.0/3
2025-10-31T08:23:50.209538Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 0
2025-10-31T08:23:50.209562Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:0 appended
2025-10-31T08:23:50.210849Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.1/3
2025-10-31T08:23:50.210883Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 1
2025-10-31T08:23:50.210902Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:1 appended
2025-10-31T08:23:50.211137Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 8.2/3
2025-10-31T08:23:50.211156Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 8 partNo 2
2025-10-31T08:23:50.214229Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:50.213609Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.213717Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213745Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213781Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213807Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213834Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213862Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213891Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:50.213916Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63'
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 15
    Offset: 15
    PartNo: 0
    WriteTimestampMS: 1761899030155
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 48
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.218966Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.226593Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 8 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 1048790 count 1 nextOffset 9 batches 3
2025-10-31T08:23:50.226670Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 8:2 appended
2025-10-31T08:23:50.226714Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000009_00000_0000000001_00002?
2025-10-31T08:23:50.226730Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.226756Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000009_00000_0000000001_00002?, parameters.CurOffset=9
2025-10-31T08:23:50.227707Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 9.0/3
2025-10-31T08:23:50.227748Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 0
2025-10-31T08:23:50.227767Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 9:0 appended
2025-10-31T08:23:50.229387Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 9.1/3
2025-10-31T08:23:50.229432Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 1
2025-10-31T08:23:50.229449Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 9:1 appended
2025-10-31T08:23:50.229726Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 9.2/3
2025-10-31T08:23:50.229744Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 9 partNo 2
2025-10-31T08:23:50.243126Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 9 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2097545 count 2 nextOffset 10 batches 5
2025-10-31T08:23:50.243210Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 9:2 appended
2025-10-31T08:23:50.243254Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000010_00000_0000000001_00002?
2025-10-31T08:23:50.243269Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.243294Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000010_00000_0000000001_00002?, parameters.CurOffset=10
2025-10-31T08:23:50.244466Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 10.0/3
2025-10-31T08:23:50.244516Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 0
2025-10-31T08:23:50.244535Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 10:0 appended
2025-10-31T08:23:50.245707Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 10.1/3
2025-10-31T08:23:50.245740Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 1
2025-10-31T08:23:50.245755Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 10:1 appended
2025-10-31T08:23:50.246016Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 10.2/3
2025-10-31T08:23:50.246048Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 10 partNo 2
2025-10-31T08:23:50.250728Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 10 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 3146300 count 3 nextOffset 11 batches 7
2025-10-31T08:23:50.250797Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 10:2 appended
2025-10-31T08:23:50.250840Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000011_00000_0000000001_00002?
2025-10-31T08:23:50.250856Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.250881Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000011_00000_0000000001_00002?, parameters.CurOffset=11
2025-10-31T08:23:50.251867Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 11.0/3
2025-10-31T08:23:50.251928Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 0
2025-10-31T08:23:50.251948Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 11:0 appended
2025-10-31T08:23:50.253068Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 11.1/3
2025-10-31T08:23:50.253098Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 1
2025-10-31T08:23:50.253114Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 11:1 appended
2025-10-31T08:23:50.253362Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 11.2/3
2025-10-31T08:23:50.253380Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 11 partNo 2
2025-10-31T08:23:50.260893Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 11 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4195055 count 4 nextOffset 12 batches 9
2025-10-31T08:23:50.261965Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 11:2 appended
2025-10-31T08:23:50.262021Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000012_00000_0000000001_00002?
2025-10-31T08:23:50.262034Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.262058Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000012_00000_0000000001_00002?, parameters.CurOffset=12
2025-10-31T08:23:50.263005Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 12.0/3
2025-10-31T08:23:50.263045Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 0
2025-10-31T08:23:50.263061Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 12:0 appended
2025-10-31T08:23:50.264202Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 12.1/3
2025-10-31T08:23:50.264229Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 1
2025-10-31T08:23:50.264245Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 12:1 appended
2025-10-31T08:23:50.264473Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 12.2/3
2025-10-31T08:23:50.264489Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 12 partNo 2
2025-10-31T08:23:50.269035Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 12 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 5243810 count 5 nextOffset 13 batches 11
2025-10-31T08:23:50.269095Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 12:2 appended
2025-10-31T08:23:50.269134Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000013_00000_0000000001_00002?
2025-10-31T08:23:50.269147Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.269171Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000013_00000_0000000001_00002?, parameters.CurOffset=13
2025-10-31T08:23:50.270142Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 13.0/3
2025-10-31T08:23:50.270179Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 0
2025-10-31T08:23:50.270196Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 13:0 appended
2025-10-31T08:23:50.271326Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 13.1/3
2025-10-31T08:23:50.271351Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 1
2025-10-31T08:23:50.271367Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 13:1 appended
2025-10-31T08:23:50.271638Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 13.2/3
2025-10-31T08:23:50.271654Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 13 partNo 2
2025-10-31T08:23:50.275304Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 13 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 6292566 count 6 nextOffset 14 batches 13
2025-10-31T08:23:50.275364Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 13:2 appended
2025-10-31T08:23:50.275403Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000014_00000_0000000001_00002?
2025-10-31T08:23:50.275416Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.275441Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000014_00000_0000000001_00002?, parameters.CurOffset=14
2025-10-31T08:23:50.276814Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 14.0/3
2025-10-31T08:23:50.276859Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 0
2025-10-31T08:23:50.276874Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 14:0 appended
2025-10-31T08:23:50.278341Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 14.1/3
2025-10-31T08:23:50.278377Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 1
2025-10-31T08:23:50.278392Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 14:1 appended
2025-10-31T08:23:50.278605Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 14.2/3
2025-10-31T08:23:50.278625Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 14 partNo 2
2025-10-31T08:23:50.288654Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 14 partNo 2 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 7341321 count 7 nextOffset 15 batches 15
2025-10-31T08:23:50.288726Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 14:2 appended
2025-10-31T08:23:50.288767Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000015_00000_0000000001_00002?
2025-10-31T08:23:50.288781Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:50.288806Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000015_00000_0000000001_00002?, parameters.CurOffset=15
2025-10-31T08:23:50.289740Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 15.0/3
2025-10-31T08:23:50.289779Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 0
2025-10-31T08:23:50.289796Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 15:0 appended
2025-10-31T08:23:50.290848Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 15.1/3
2025-10-31T08:23:50.290873Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 1
2025-10-31T08:23:50.415803Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 15 partNo 1 result is x0000000000_00000000000000000007_00002_0000000008_00015 size 7878064
2025-10-31T08:23:50.415862Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 15:1 appended
2025-10-31T08:23:50.416127Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 15.2/3
2025-10-31T08:23:50.416171Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 15 partNo 2
2025-10-31T08:23:50.416244Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000007_00002_0000000008_00015 new key d0000000000_00000000000000000007_00002_0000000008_00015 size 7878064 WTime 1761899030413
2025-10-31T08:23:50.424461Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 15 partNo 2 FormedBlobsCount 1 NewHead: Offset 15 PartNo 1 PackedSize 536763 count 1 nextOffset 16 batches 2
2025-10-31T08:23:50.424532Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 15:2 appended
2025-10-31T08:23:50.425469Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 15,1 HeadOffset 7 endOffset 8 curOffset 16 d0000000000_00000000000000000015_00001_0000000001_00001| size 536753 WTime 1761899030424
2025-10-31T08:23:50.426260Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017938:3629] destroyed
2025-10-31T08:23:50.426310Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017942:3632], now have 1 active actors on pipe
2025-10-31T08:23:50.426379Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.426409Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.426475Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.426489Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.426504Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.426550Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.426754Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 2 count 8 size 7878064
2025-10-31T08:23:50.426840Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 1 count 1 size 536753
2025-10-31T08:23:50.426947Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8d040249-f0ab17bb-eff44651-cb2a193f_16 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.426978Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.426996Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.427010Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.427059Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.427101Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.427290Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.428724Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:50.431409Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017942:3632] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8d040249-f0ab17bb-eff44651-cb2a193f_16"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|8d040249-f0ab17bb-eff44651-cb2a193f_16"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 16
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.480156Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.481267Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017947:3636], now have 1 active actors on pipe
2025-10-31T08:23:50.487841Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.487918Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.488450Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.488948Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.488988Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.489019Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 16 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.489494Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.489551Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.489581Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.489592Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.489752Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 0
2025-10-31T08:23:50.489799Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 1
2025-10-31T08:23:50.489820Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 2
2025-10-31T08:23:50.495767Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 16 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 1048790 count 1 nextOffset 17 batches 3
2025-10-31T08:23:50.495853Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.497098Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 16,1 HeadOffset 16 endOffset 16 curOffset 17 d0000000000_00000000000000000016_00000_0000000001_00002? size 1048780 WTime 1761899030495
2025-10-31T08:23:50.498716Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.498912Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.505182Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 8 size 7878064 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.505230Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 1 size 536753 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.505293Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.506326Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:50.506350Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.506737Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:50.506788Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 1 parts 1 suffix '124' size 536753
2025-10-31T08:23:50.511491Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.511567Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.511628Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.511656Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.511717Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 0, Offset: 16 is stored on disk
2025-10-31T08:23:50.511735Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.511761Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 1, Offset: 16 is stored on disk
2025-10-31T08:23:50.511786Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.511812Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 16, partNo: 2, Offset: 16 is stored on disk
2025-10-31T08:23:50.512288Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.512309Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.512324Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.512525Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.512624Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.512682Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.512716Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000001_00002?(+) to d0000000000_00000000000000000008_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512730Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000009_00000_0000000001_00002?(+) to d0000000000_00000000000000000009_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512741Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000001_00002?(+) to d0000000000_00000000000000000010_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512755Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000001_00002?(+) to d0000000000_00000000000000000011_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512768Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000012_00000_0000000001_00002?(+) to d0000000000_00000000000000000012_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512781Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000001_00002?(+) to d0000000000_00000000000000000013_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512793Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000001_00002?(+) to d0000000000_00000000000000000014_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512806Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00000_0000000001_00002?(+) to d0000000000_00000000000000000015_00000_0000000001_00002?(+)
2025-10-31T08:23:50.512818Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00002_0000000001_00000|(+) to d0000000000_00000000000000000007_00002_0000000001_00000|(+)
2025-10-31T08:23:50.515121Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 16
    Offset: 16
    PartNo: 0
    WriteTimestampMS: 1761899030487
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 20
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.514397Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.518101Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017947:3636] destroyed
2025-10-31T08:23:50.518483Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518527Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 9 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518568Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 10 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518603Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 11 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518645Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 12 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518694Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 13 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518733Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 14 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518768Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 15 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518808Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.518898Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.518948Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.518981Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.518997Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.519013Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.519059Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.519293Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.519548Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.519772Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.520020Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.520262Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 12 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.520470Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.520681Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.521089Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 15 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.521502Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 1 parts 0 suffix '124' size 24726
2025-10-31T08:23:50.524632Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.524665Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.524680Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.527266Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.528675Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017956:3643], now have 1 active actors on pipe
2025-10-31T08:23:50.528756Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.528785Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.528915Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|547ba9be-bc83d259-36bacd82-728b3e5b_17 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.528959Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.528979Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.528995Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.529047Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.529093Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.529169Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.530131Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|547ba9be-bc83d259-36bacd82-728b3e5b_17"
    Status: Active
    SeqNo: 0
  }
}
2025-10-31T08:23:50.530738Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017956:3643] destroyed
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|547ba9be-bc83d259-36bacd82-728b3e5b_17"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 17
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.579418Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.581462Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017958:3644], now have 1 active actors on pipe
2025-10-31T08:23:50.586892Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.586956Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.587466Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.587962Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.588003Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.588038Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 17 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.588862Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.588928Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.588961Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.588974Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.589133Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 0
2025-10-31T08:23:50.589182Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 1
2025-10-31T08:23:50.589203Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 2
2025-10-31T08:23:50.596941Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 17 partNo 2 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 1048790 count 1 nextOffset 18 batches 3
2025-10-31T08:23:50.597031Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.598579Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 17,1 HeadOffset 17 endOffset 17 curOffset 18 d0000000000_00000000000000000017_00000_0000000001_00002? size 1048780 WTime 1761899030594
2025-10-31T08:23:50.599790Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.600016Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.611247Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.611331Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.611391Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.611419Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.611473Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 0, Offset: 17 is stored on disk
2025-10-31T08:23:50.611491Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.611517Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 1, Offset: 17 is stored on disk
2025-10-31T08:23:50.611541Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.611567Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 17, partNo: 2, Offset: 17 is stored on disk
2025-10-31T08:23:50.612311Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.612333Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.612348Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.612402Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.612508Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.613139Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.613394Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-31T08:23:50.616142Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017958:3644] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 17
    Offset: 17
    PartNo: 0
    WriteTimestampMS: 1761899030587
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 20
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.623042Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.624625Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017963:3648], now have 1 active actors on pipe
2025-10-31T08:23:50.624705Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.624736Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.624887Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8323f61f-b896cb29-35ceea37-e04dff81_18 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.624923Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.624943Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.624959Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.625014Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.625066Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.625139Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.625833Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8323f61f-b896cb29-35ceea37-e04dff81_18"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:50.629246Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.629280Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.629294Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.632450Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017963:3648] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|8323f61f-b896cb29-35ceea37-e04dff81_18"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 18
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.649494Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.650493Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017965:3649], now have 1 active actors on pipe
2025-10-31T08:23:50.656099Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.656161Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.656665Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.657143Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.657186Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.657217Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 18 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.657618Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.657696Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.657733Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.657745Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.658261Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 0
2025-10-31T08:23:50.658343Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 1
2025-10-31T08:23:50.658364Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 2
2025-10-31T08:23:50.665885Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 18 partNo 2 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 1048790 count 1 nextOffset 19 batches 3
2025-10-31T08:23:50.665976Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.667155Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 18,1 HeadOffset 18 endOffset 18 curOffset 19 d0000000000_00000000000000000018_00000_0000000001_00002? size 1048780 WTime 1761899030663
2025-10-31T08:23:50.674607Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.674828Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.700683Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.700764Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.700826Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.700852Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.700900Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 0, Offset: 18 is stored on disk
2025-10-31T08:23:50.700917Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.700942Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 1, Offset: 18 is stored on disk
2025-10-31T08:23:50.700963Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.700988Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 18, partNo: 2, Offset: 18 is stored on disk
2025-10-31T08:23:50.701604Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.701623Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.701637Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.701696Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.701787Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.702692Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-31T08:23:50.702404Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63' size 1048780
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 18
    Offset: 18
    PartNo: 0
    WriteTimestampMS: 1761899030655
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 43
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-10-31T08:23:50.704887Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017965:3649] destroyed
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.707934Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.708771Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017972:3652], now have 1 active actors on pipe
2025-10-31T08:23:50.709571Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.709612Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.709762Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8eee9cb-aec9f455-e44a80f5-e6e0bde5_19 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.709804Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.709822Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.709838Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.709890Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.709941Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.710009Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.710456Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8eee9cb-aec9f455-e44a80f5-e6e0bde5_19"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:50.720732Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017972:3652] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|8eee9cb-aec9f455-e44a80f5-e6e0bde5_19"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 19
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.735066Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.735179Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.735209Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.735223Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.736201Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017974:3653], now have 1 active actors on pipe
2025-10-31T08:23:50.752613Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.752656Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.753135Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.753682Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.753727Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.753756Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 19 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.754138Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.754194Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.754221Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.754230Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.754328Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 0
2025-10-31T08:23:50.754357Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 1
2025-10-31T08:23:50.754370Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 2
2025-10-31T08:23:50.757919Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 19 partNo 2 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1048790 count 1 nextOffset 20 batches 3
2025-10-31T08:23:50.758001Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.759079Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 19,1 HeadOffset 19 endOffset 19 curOffset 20 d0000000000_00000000000000000019_00000_0000000001_00002? size 1048780 WTime 1761899030755
2025-10-31T08:23:50.760400Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.760594Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.778402Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 19 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.778483Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.778545Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.778569Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.778617Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 0, Offset: 19 is stored on disk
2025-10-31T08:23:50.778634Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.778660Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 1, Offset: 19 is stored on disk
2025-10-31T08:23:50.778685Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.778709Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 19, partNo: 2, Offset: 19 is stored on disk
2025-10-31T08:23:50.779312Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.779331Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.779346Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.779395Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.779487Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.780020Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.780251Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 19
    Offset: 19
    PartNo: 0
    WriteTimestampMS: 1761899030751
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 26
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.783802Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017974:3653] destroyed
2025-10-31T08:23:50.784013Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.784729Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017979:3657], now have 1 active actors on pipe
2025-10-31T08:23:50.785183Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.785220Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.785353Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|e9f7e301-5cdcbdb7-16c65dcd-b9975596_20 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.785389Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.785407Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.785424Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.785474Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.785526Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.785609Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.786102Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|e9f7e301-5cdcbdb7-16c65dcd-b9975596_20"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|e9f7e301-5cdcbdb7-16c65dcd-b9975596_20"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 20
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.795868Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017979:3657] destroyed
2025-10-31T08:23:50.817610Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.820708Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017981:3658], now have 1 active actors on pipe
2025-10-31T08:23:50.825347Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.825405Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.826208Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.826762Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.826800Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.826835Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 20 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.827216Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.827275Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.827308Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.827321Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.827470Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 0
2025-10-31T08:23:50.827515Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 1
2025-10-31T08:23:50.827536Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 2
2025-10-31T08:23:50.836002Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 20 partNo 2 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 1048790 count 1 nextOffset 21 batches 3
2025-10-31T08:23:50.836089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.837189Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 20,1 HeadOffset 20 endOffset 20 curOffset 21 d0000000000_00000000000000000020_00000_0000000001_00002? size 1048780 WTime 1761899030836
2025-10-31T08:23:50.838345Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:50.838367Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.838557Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.849226Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.849304Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.849363Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.849388Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.849435Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 0, Offset: 20 is stored on disk
2025-10-31T08:23:50.849453Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.849477Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 1, Offset: 20 is stored on disk
2025-10-31T08:23:50.849501Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.849522Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 20, partNo: 2, Offset: 20 is stored on disk
2025-10-31T08:23:50.850195Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.850214Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.850227Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.850267Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.850356Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.856238Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 20
    Offset: 20
    PartNo: 0
    WriteTimestampMS: 1761899030824
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.855553Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.861323Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.862477Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017981:3658] destroyed
2025-10-31T08:23:50.862553Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017985:3661], now have 1 active actors on pipe
2025-10-31T08:23:50.862617Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.862648Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.862782Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|a3892109-fc3d63e7-12e95141-47de2eed_21 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.862822Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.862843Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.862858Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.862916Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.862971Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.863043Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.863689Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|a3892109-fc3d63e7-12e95141-47de2eed_21"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:50.869559Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017985:3661] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|a3892109-fc3d63e7-12e95141-47de2eed_21"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 21
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:50.886354Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.887303Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822017987:3662], now have 1 active actors on pipe
2025-10-31T08:23:50.895055Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.895109Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.895723Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:50.896270Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:50.896305Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:50.896335Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 21 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:50.896861Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:50.896917Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.896945Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.896957Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:50.897101Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 0
2025-10-31T08:23:50.897147Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 1
2025-10-31T08:23:50.897166Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 2
2025-10-31T08:23:50.918196Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 21 partNo 2 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 1048790 count 1 nextOffset 22 batches 3
2025-10-31T08:23:50.918293Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.919364Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 21,1 HeadOffset 21 endOffset 21 curOffset 22 d0000000000_00000000000000000021_00000_0000000001_00002? size 1048780 WTime 1761899030914
2025-10-31T08:23:50.920717Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:50.920914Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 0 count 1 size 1048780
2025-10-31T08:23:50.942621Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:50.944710Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:50.944811Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:50.944867Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:50.944879Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:50.944906Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.944955Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 0, Offset: 21 is stored on disk
2025-10-31T08:23:50.944973Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.944995Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 1, Offset: 21 is stored on disk
2025-10-31T08:23:50.945019Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:50.945042Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 21, partNo: 2, Offset: 21 is stored on disk
2025-10-31T08:23:50.945724Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.945745Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.945760Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.945807Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:50.945899Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.946728Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:50.949915Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822017987:3662] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 21
    Offset: 21
    PartNo: 0
    WriteTimestampMS: 1761899030895
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 46
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:50.955793Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:50.958877Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298713822018006:3673], now have 1 active actors on pipe
2025-10-31T08:23:50.958958Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:50.958988Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:50.959938Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|2449ad50-98a59936-3930b5fa-af3d3a16_22"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:50.959122Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|2449ad50-98a59936-3930b5fa-af3d3a16_22 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:50.959172Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:50.959193Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:50.959209Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:50.959262Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:50.959311Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:50.959373Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:50.961176Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298713822018006:3673] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|2449ad50-98a59936-3930b5fa-af3d3a16_22"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 22
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.009837Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.010855Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985309:3676], now have 1 active actors on pipe
2025-10-31T08:23:51.022368Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.022421Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.022910Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.023409Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.023448Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.023479Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 22 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.043909Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.043989Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.044018Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.044028Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.044165Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 0
2025-10-31T08:23:51.044210Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 1
2025-10-31T08:23:51.044226Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 2
2025-10-31T08:23:51.056939Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 22 partNo 2 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 1048790 count 1 nextOffset 23 batches 3
2025-10-31T08:23:51.057028Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.058100Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 22,1 HeadOffset 22 endOffset 22 curOffset 23 d0000000000_00000000000000000022_00000_0000000001_00002? size 1048780 WTime 1761899031055
2025-10-31T08:23:51.059467Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:51.059503Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.059681Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.071570Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.071648Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.071709Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.071738Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.071787Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 0, Offset: 22 is stored on disk
2025-10-31T08:23:51.071814Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.071838Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 1, Offset: 22 is stored on disk
2025-10-31T08:23:51.071861Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.071896Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 22, partNo: 2, Offset: 22 is stored on disk
2025-10-31T08:23:51.072482Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.072502Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.072517Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.072565Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.072659Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.073385Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.074034Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 22
    Offset: 22
    PartNo: 0
    WriteTimestampMS: 1761899031043
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-10-31T08:23:51.076508Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985309:3676] destroyed
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.099474Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.103003Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985320:3681], now have 1 active actors on pipe
2025-10-31T08:23:51.103110Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.103139Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.103274Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|3970fb24-30dab699-926781cf-f5d4069a_23 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.103313Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.103332Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.103346Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.103400Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.103453Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.103523Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.104114Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:51.105326Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985320:3681] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|3970fb24-30dab699-926781cf-f5d4069a_23"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|3970fb24-30dab699-926781cf-f5d4069a_23"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 23
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.140437Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.146928Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985327:3684], now have 1 active actors on pipe
2025-10-31T08:23:51.152017Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.152056Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.152611Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.153132Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.153166Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.153194Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 23 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.153616Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.153692Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.153720Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.153732Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.153869Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 0
2025-10-31T08:23:51.153913Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 1
2025-10-31T08:23:51.153930Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 2
2025-10-31T08:23:51.185455Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 23 partNo 2 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 1048790 count 1 nextOffset 24 batches 3
2025-10-31T08:23:51.185553Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.186677Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 23,1 HeadOffset 23 endOffset 23 curOffset 24 d0000000000_00000000000000000023_00000_0000000001_00002? size 1048780 WTime 1761899031185
2025-10-31T08:23:51.187748Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:51.187770Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.188211Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.204933Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.205017Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.205078Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.205104Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.205156Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 0, Offset: 23 is stored on disk
2025-10-31T08:23:51.205175Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.205200Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 1, Offset: 23 is stored on disk
2025-10-31T08:23:51.205229Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.205252Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 23, partNo: 2, Offset: 23 is stored on disk
2025-10-31T08:23:51.205859Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.205878Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.205893Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.205944Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.205958Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.205973Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.205987Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.206001Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.206016Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.206033Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.206046Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000001_00002? (1048780)
2025-10-31T08:23:51.206060Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-10-31T08:23:51.206160Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.206219Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-10-31T08:23:51.206243Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000001_00002?
2025-10-31T08:23:51.206422Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000001_00002?
2025-10-31T08:23:51.206603Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000001_00002?
2025-10-31T08:23:51.206777Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000019_00000_0000000001_00002?
2025-10-31T08:23:51.206903Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000001_00002?
2025-10-31T08:23:51.207024Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.207156Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00000_0000000001_00002?
2025-10-31T08:23:51.207270Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000001_00002?
2025-10-31T08:23:51.207372Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00000_0000000001_00002?
2025-10-31T08:23:51.207484Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-10-31T08:23:51.207534Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:51.207554Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:51.207576Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:51.207595Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 19 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:51.207614Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:51.207632Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 21 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:51.207650Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 22 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:51.207668Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:51.207717Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-10-31T08:23:51.207818Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-31T08:23:51.207864Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000016_00000_0000000001_00002?
2025-10-31T08:23:51.207961Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.207990Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.208014Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.208036Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.208061Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.208086Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.208112Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.208138Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:51.209823Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:51.212311Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
CallPersQueueGRPC response:
2025-10-31T08:23:51.212370Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000016_00000_0000000001_00002?, parameters.CurOffset=16
2025-10-31T08:23:51.213340Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 16.0/3
2025-10-31T08:23:51.213387Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 0
2025-10-31T08:23:51.213411Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 16:0 appended
2025-10-31T08:23:51.214545Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 16.1/3
2025-10-31T08:23:51.214573Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 1
2025-10-31T08:23:51.214590Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 16:1 appended
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 23
    Offset: 23
    PartNo: 0
    WriteTimestampMS: 1761899031152
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 51
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-10-31T08:23:51.214821Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 16.2/3
2025-10-31T08:23:51.214842Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 16 partNo 2
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.219290Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.280455Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 16 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 1048790 count 1 nextOffset 17 batches 3
2025-10-31T08:23:51.280530Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 16:2 appended
2025-10-31T08:23:51.280574Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000017_00000_0000000001_00002?
2025-10-31T08:23:51.280588Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.280612Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000017_00000_0000000001_00002?, parameters.CurOffset=17
2025-10-31T08:23:51.281497Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 17.0/3
2025-10-31T08:23:51.281535Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 0
2025-10-31T08:23:51.281553Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 17:0 appended
2025-10-31T08:23:51.282624Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 17.1/3
2025-10-31T08:23:51.282649Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 1
2025-10-31T08:23:51.282663Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 17:1 appended
2025-10-31T08:23:51.288138Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 17.2/3
2025-10-31T08:23:51.288186Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 17 partNo 2
2025-10-31T08:23:51.306391Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 17 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2097545 count 2 nextOffset 18 batches 5
2025-10-31T08:23:51.315092Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 17:2 appended
2025-10-31T08:23:51.315156Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000018_00000_0000000001_00002?
2025-10-31T08:23:51.315170Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.315196Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000018_00000_0000000001_00002?, parameters.CurOffset=18
2025-10-31T08:23:51.316217Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 18.0/3
2025-10-31T08:23:51.316260Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 0
2025-10-31T08:23:51.316279Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 18:0 appended
2025-10-31T08:23:51.317402Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 18.1/3
2025-10-31T08:23:51.317431Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 1
2025-10-31T08:23:51.317447Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 18:1 appended
2025-10-31T08:23:51.317597Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 18.2/3
2025-10-31T08:23:51.317614Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 18 partNo 2
2025-10-31T08:23:51.321141Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 18 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 3146300 count 3 nextOffset 19 batches 7
2025-10-31T08:23:51.321202Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 18:2 appended
2025-10-31T08:23:51.321240Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000019_00000_0000000001_00002?
2025-10-31T08:23:51.321256Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.321283Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000019_00000_0000000001_00002?, parameters.CurOffset=19
2025-10-31T08:23:51.322310Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 19.0/3
2025-10-31T08:23:51.322344Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 0
2025-10-31T08:23:51.322359Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 19:0 appended
2025-10-31T08:23:51.326119Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 19.1/3
2025-10-31T08:23:51.326168Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 1
2025-10-31T08:23:51.326186Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 19:1 appended
2025-10-31T08:23:51.326313Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 19.2/3
2025-10-31T08:23:51.326332Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 19 partNo 2
2025-10-31T08:23:51.342214Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 19 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4195055 count 4 nextOffset 20 batches 9
2025-10-31T08:23:51.342286Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 19:2 appended
2025-10-31T08:23:51.342331Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000020_00000_0000000001_00002?
2025-10-31T08:23:51.342345Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.342372Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000020_00000_0000000001_00002?, parameters.CurOffset=20
2025-10-31T08:23:51.343475Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 20.0/3
2025-10-31T08:23:51.343526Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 0
2025-10-31T08:23:51.343542Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 20:0 appended
2025-10-31T08:23:51.344509Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 20.1/3
2025-10-31T08:23:51.344535Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 1
2025-10-31T08:23:51.344551Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 20:1 appended
2025-10-31T08:23:51.344672Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 20.2/3
2025-10-31T08:23:51.344687Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 20 partNo 2
2025-10-31T08:23:51.347344Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 20 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 5243810 count 5 nextOffset 21 batches 11
2025-10-31T08:23:51.347391Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 20:2 appended
2025-10-31T08:23:51.347428Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000021_00000_0000000001_00002?
2025-10-31T08:23:51.347444Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.347471Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000021_00000_0000000001_00002?, parameters.CurOffset=21
2025-10-31T08:23:51.348801Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 21.0/3
2025-10-31T08:23:51.348839Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 0
2025-10-31T08:23:51.348853Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 21:0 appended
2025-10-31T08:23:51.349826Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 21.1/3
2025-10-31T08:23:51.349849Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 1
2025-10-31T08:23:51.349865Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 21:1 appended
2025-10-31T08:23:51.349986Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 21.2/3
2025-10-31T08:23:51.350003Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 21 partNo 2
2025-10-31T08:23:51.360920Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 21 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 6292565 count 6 nextOffset 22 batches 13
2025-10-31T08:23:51.360981Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 21:2 appended
2025-10-31T08:23:51.361028Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000022_00000_0000000001_00002?
2025-10-31T08:23:51.361043Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.361070Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000022_00000_0000000001_00002?, parameters.CurOffset=22
2025-10-31T08:23:51.361982Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 22.0/3
2025-10-31T08:23:51.362023Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 0
2025-10-31T08:23:51.362077Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 22:0 appended
2025-10-31T08:23:51.363099Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 22.1/3
2025-10-31T08:23:51.368240Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 1
2025-10-31T08:23:51.368274Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 22:1 appended
2025-10-31T08:23:51.371418Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 22.2/3
2025-10-31T08:23:51.371460Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 22 partNo 2
2025-10-31T08:23:51.410190Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 22 partNo 2 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 7341321 count 7 nextOffset 23 batches 15
2025-10-31T08:23:51.410280Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 22:2 appended
2025-10-31T08:23:51.410334Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000023_00000_0000000001_00002?
2025-10-31T08:23:51.410349Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:51.410379Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000023_00000_0000000001_00002?, parameters.CurOffset=23
2025-10-31T08:23:51.411415Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 23.0/3
2025-10-31T08:23:51.411459Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 0
2025-10-31T08:23:51.487942Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 23 partNo 0 result is x0000000000_00000000000000000015_00001_0000000008_00015 size 7878064
2025-10-31T08:23:51.487991Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 23:0 appended
2025-10-31T08:23:51.489120Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 23.1/3
2025-10-31T08:23:51.489168Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 1
2025-10-31T08:23:51.489190Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 23:1 appended
2025-10-31T08:23:51.489311Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 23.2/3
2025-10-31T08:23:51.489329Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 23 partNo 2
2025-10-31T08:23:51.489405Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000015_00001_0000000008_00015 new key d0000000000_00000000000000000015_00001_0000000008_00015 size 7878064 WTime 1761899031487
2025-10-31T08:23:51.500427Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 23 partNo 2 FormedBlobsCount 1 NewHead: Offset 23 PartNo 0 PackedSize 1048790 count 1 nextOffset 24 batches 3
2025-10-31T08:23:51.500516Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 23:2 appended
2025-10-31T08:23:51.501547Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 23,1 HeadOffset 15 endOffset 16 curOffset 24 d0000000000_00000000000000000023_00000_0000000001_00002| size 1048780 WTime 1761899031500
2025-10-31T08:23:51.502704Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985327:3684] destroyed
2025-10-31T08:23:51.502767Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985332:3688], now have 1 active actors on pipe
2025-10-31T08:23:51.502848Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.502878Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.502952Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.502965Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.502980Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.503055Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.503265Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 15 partNo 1 count 8 size 7878064
2025-10-31T08:23:51.503366Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.504007Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9a575d91-ba728c-3c21b63d-43fa596_24 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.504055Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.504073Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.504089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.504143Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.504190Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.504420Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.508172Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:51.509754Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985332:3688] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9a575d91-ba728c-3c21b63d-43fa596_24"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|9a575d91-ba728c-3c21b63d-43fa596_24"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 24
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.552399Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.560013Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985362:3701], now have 1 active actors on pipe
2025-10-31T08:23:51.564737Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.564795Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.565341Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.565926Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.565963Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.566000Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 24 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.566247Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.566307Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.566354Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.566366Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.566532Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 0
2025-10-31T08:23:51.566577Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 1
2025-10-31T08:23:51.566595Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 2
2025-10-31T08:23:51.576907Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 24 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 1048790 count 1 nextOffset 25 batches 3
2025-10-31T08:23:51.577003Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.578598Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 24,1 HeadOffset 24 endOffset 24 curOffset 25 d0000000000_00000000000000000024_00000_0000000001_00002? size 1048780 WTime 1761899031575
2025-10-31T08:23:51.579813Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.580053Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.587242Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 15 count 8 size 7878064 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.587302Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.587375Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.589039Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:51.589078Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.589618Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:51.589780Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365344
2025-10-31T08:23:51.589826Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '124' size 1048780
2025-10-31T08:23:51.595006Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8365344 cause it's been evicted from L2. Actual L1 size: 12
2025-10-31T08:23:51.595059Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:51.600649Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 24 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.600735Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.600801Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.600831Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.600885Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 0, Offset: 24 is stored on disk
2025-10-31T08:23:51.600904Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.600929Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 1, Offset: 24 is stored on disk
2025-10-31T08:23:51.600956Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.600979Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 24, partNo: 2, Offset: 24 is stored on disk
2025-10-31T08:23:51.601470Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.601490Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.601505Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.601738Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.601838Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.601899Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.601934Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000001_00002?(+) to d0000000000_00000000000000000016_00000_0000000001_00002?(+)
2025-10-31T08:23:51.601948Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000001_00002?(+) to d0000000000_00000000000000000017_00000_0000000001_00002?(+)
2025-10-31T08:23:51.601959Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000001_00002?(+) to d0000000000_00000000000000000018_00000_0000000001_00002?(+)
2025-10-31T08:23:51.601968Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000019_00000_0000000001_00002?(+) to d0000000000_00000000000000000019_00000_0000000001_00002?(+)
2025-10-31T08:23:51.601979Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000001_00002?(+) to d0000000000_00000000000000000020_00000_0000000001_00002?(+)
2025-10-31T08:23:51.601991Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00000_0000000001_00002?(+) to d0000000000_00000000000000000021_00000_0000000001_00002?(+)
2025-10-31T08:23:51.602001Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000001_00002?(+) to d0000000000_00000000000000000022_00000_0000000001_00002?(+)
2025-10-31T08:23:51.602011Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000001_00002?(+) to d0000000000_00000000000000000023_00000_0000000001_00002?(+)
2025-10-31T08:23:51.602022Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000015_00001_0000000001_00001|(+) to d0000000000_00000000000000000015_00001_0000000001_00001|(+)
2025-10-31T08:23:51.602331Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.602572Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 24
    Offset: 24
    PartNo: 0
    WriteTimestampMS: 1761899031563
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 36
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.604948Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:51.605023Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985362:3701] destroyed
2025-10-31T08:23:51.610264Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.611434Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 16 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611491Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 17 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611526Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 18 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611563Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 19 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611603Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 20 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611637Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 21 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611672Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 22 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611705Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 23 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611744Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 15 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.611821Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.611870Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.611920Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.611936Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.611950Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.611996Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.612217Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.612478Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.612667Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.612860Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.613089Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.613292Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.613484Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.613691Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.613883Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 1 parts 1 suffix '124' size 536753
2025-10-31T08:23:51.614883Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985368:3707], now have 1 active actors on pipe
2025-10-31T08:23:51.616134Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.616169Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.616315Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|64974bb8-a95ec6f5-8687ef54-2adcfea4_25 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.616355Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.616377Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.616391Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.616446Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.616498Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.616568Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|64974bb8-a95ec6f5-8687ef54-2adcfea4_25"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:51.617970Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:51.624257Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985368:3707] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|64974bb8-a95ec6f5-8687ef54-2adcfea4_25"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 25
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.644723Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985373:3711], now have 1 active actors on pipe
2025-10-31T08:23:51.643908Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.650183Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.650247Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.650765Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.651243Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.651279Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.651318Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 25 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.651622Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.651681Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.651713Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.651725Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.652237Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 0
2025-10-31T08:23:51.652298Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 1
2025-10-31T08:23:51.652316Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 2
2025-10-31T08:23:51.658525Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 25 partNo 2 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 1048790 count 1 nextOffset 26 batches 3
2025-10-31T08:23:51.658621Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.659768Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 25,1 HeadOffset 25 endOffset 25 curOffset 26 d0000000000_00000000000000000025_00000_0000000001_00002? size 1048780 WTime 1761899031656
2025-10-31T08:23:51.660915Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.661130Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.671226Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.671313Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.671375Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.671406Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.671458Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 0, Offset: 25 is stored on disk
2025-10-31T08:23:51.671477Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.671502Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 1, Offset: 25 is stored on disk
2025-10-31T08:23:51.671525Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.671551Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 25, partNo: 2, Offset: 25 is stored on disk
2025-10-31T08:23:51.672163Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.672187Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.672202Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.672256Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.672362Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.673223Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.673532Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 25
    Offset: 25
    PartNo: 0
    WriteTimestampMS: 1761899031647
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 4
    WriteTimeMs: 16
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.675803Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985373:3711] destroyed
2025-10-31T08:23:51.677291Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.678319Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985378:3715], now have 1 active actors on pipe
2025-10-31T08:23:51.678861Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.678899Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.679034Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|888183c3-edd2c57b-ddeea159-beace5c3_26 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.679075Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.679094Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.679110Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.679165Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.679219Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.679309Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.680048Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|888183c3-edd2c57b-ddeea159-beace5c3_26"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:51.683379Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985378:3715] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|888183c3-edd2c57b-ddeea159-beace5c3_26"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 26
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.702464Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.703483Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985383:3716], now have 1 active actors on pipe
2025-10-31T08:23:51.705961Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.705992Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.706009Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.709408Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.709472Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.709973Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.710414Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.710453Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.710489Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 26 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.710783Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.710844Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.710876Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.710888Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.711045Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 0
2025-10-31T08:23:51.711089Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 1
2025-10-31T08:23:51.711108Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 2
2025-10-31T08:23:51.718725Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 26 partNo 2 FormedBlobsCount 0 NewHead: Offset 26 PartNo 0 PackedSize 1048790 count 1 nextOffset 27 batches 3
2025-10-31T08:23:51.718824Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.720093Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 26,1 HeadOffset 26 endOffset 26 curOffset 27 d0000000000_00000000000000000026_00000_0000000001_00002? size 1048780 WTime 1761899031720
2025-10-31T08:23:51.721243Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.721464Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 26 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.732989Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 26 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.733086Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.733150Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.733179Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.733232Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 0, Offset: 26 is stored on disk
2025-10-31T08:23:51.733250Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.733275Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 1, Offset: 26 is stored on disk
2025-10-31T08:23:51.733301Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.733324Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 26, partNo: 2, Offset: 26 is stored on disk
2025-10-31T08:23:51.733826Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.733845Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.733860Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.733912Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.734007Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
2025-10-31T08:23:51.734838Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 26
    Offset: 26
    PartNo: 0
    WriteTimestampMS: 1761899031707
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 24
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.734631Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.737004Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985383:3716] destroyed
2025-10-31T08:23:51.737957Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.739312Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985387:3719], now have 1 active actors on pipe
2025-10-31T08:23:51.739804Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.739853Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.740019Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|396b3205-b9d974f9-2b0a5424-32948a4b_27 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.740061Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.740083Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.740099Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.740159Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.740224Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.740298Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.741106Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:51.744642Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985387:3719] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|396b3205-b9d974f9-2b0a5424-32948a4b_27"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|396b3205-b9d974f9-2b0a5424-32948a4b_27"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 27
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.785986Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.788518Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985389:3720], now have 1 active actors on pipe
2025-10-31T08:23:51.795982Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.796049Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.796743Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.797360Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.797400Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.797435Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 27 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.797706Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.797766Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.797798Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.797812Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.797979Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 0
2025-10-31T08:23:51.798027Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 1
2025-10-31T08:23:51.798047Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 2
2025-10-31T08:23:51.807611Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 27 partNo 2 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 1048790 count 1 nextOffset 28 batches 3
2025-10-31T08:23:51.810812Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.812120Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 27,1 HeadOffset 27 endOffset 27 curOffset 28 d0000000000_00000000000000000027_00000_0000000001_00002? size 1048780 WTime 1761899031811
2025-10-31T08:23:51.813633Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:51.813678Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.813885Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.838039Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.838123Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.838184Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.838213Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.838268Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 0, Offset: 27 is stored on disk
2025-10-31T08:23:51.838293Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.838319Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 1, Offset: 27 is stored on disk
2025-10-31T08:23:51.838330Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.838345Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.838371Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 27, partNo: 2, Offset: 27 is stored on disk
2025-10-31T08:23:51.838821Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.838846Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.838862Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.838910Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.838993Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.839208Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
2025-10-31T08:23:51.841818Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985389:3720] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 27
    Offset: 27
    PartNo: 0
    WriteTimestampMS: 1761899031795
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 38
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.844947Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.852172Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985398:3726], now have 1 active actors on pipe
2025-10-31T08:23:51.852529Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.852570Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.852707Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|8b126e26-bf21a870-5e905164-2b77a24a_28 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.852751Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.852771Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.852786Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.852844Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.852902Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.852973Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.853825Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|8b126e26-bf21a870-5e905164-2b77a24a_28"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:51.860837Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985398:3726] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|8b126e26-bf21a870-5e905164-2b77a24a_28"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 28
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.888731Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.892394Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985400:3728], now have 1 active actors on pipe
2025-10-31T08:23:51.899428Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.899496Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.900208Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.900867Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.900937Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.900974Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 28 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.901290Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.901354Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.901389Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.901402Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.901577Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 0
2025-10-31T08:23:51.901622Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 1
2025-10-31T08:23:51.901642Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 2
2025-10-31T08:23:51.916825Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 28 partNo 2 FormedBlobsCount 0 NewHead: Offset 28 PartNo 0 PackedSize 1048790 count 1 nextOffset 29 batches 3
2025-10-31T08:23:51.916934Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.918165Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 28,1 HeadOffset 28 endOffset 28 curOffset 29 d0000000000_00000000000000000028_00000_0000000001_00002? size 1048780 WTime 1761899031915
2025-10-31T08:23:51.919662Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:51.919686Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:51.919917Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 0 count 1 size 1048780
2025-10-31T08:23:51.941989Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:51.942083Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:51.942144Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:51.942175Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.942228Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 0, Offset: 28 is stored on disk
2025-10-31T08:23:51.942247Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.942271Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 1, Offset: 28 is stored on disk
2025-10-31T08:23:51.942295Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:51.942320Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 28, partNo: 2, Offset: 28 is stored on disk
2025-10-31T08:23:51.942859Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.942879Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.942895Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.942948Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:51.943050Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.943623Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:51.945780Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985400:3728] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 28
    Offset: 28
    PartNo: 0
    WriteTimestampMS: 1761899031900
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:51.943921Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:51.953646Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.956217Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985412:3736], now have 1 active actors on pipe
2025-10-31T08:23:51.956766Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.956807Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.956939Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|d131e928-56680ec-721be13-3379cf46_29 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:51.956978Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.956998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.957012Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:51.957067Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:51.957121Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:51.957193Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:51.957700Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|d131e928-56680ec-721be13-3379cf46_29"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:51.964413Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985412:3736] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|d131e928-56680ec-721be13-3379cf46_29"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 29
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:51.982883Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:51.983790Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298718116985415:3740], now have 1 active actors on pipe
2025-10-31T08:23:51.993741Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:51.993804Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:51.994460Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:51.995063Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:51.995101Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:51.995134Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 29 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:51.995533Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:51.995593Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:51.995626Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:51.995638Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:51.995792Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 0
2025-10-31T08:23:51.995836Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 1
2025-10-31T08:23:51.995854Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 2
2025-10-31T08:23:52.020427Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 29 partNo 2 FormedBlobsCount 0 NewHead: Offset 29 PartNo 0 PackedSize 1048790 count 1 nextOffset 30 batches 3
2025-10-31T08:23:52.020529Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.021620Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 29,1 HeadOffset 29 endOffset 29 curOffset 30 d0000000000_00000000000000000029_00000_0000000001_00002? size 1048780 WTime 1761899032019
2025-10-31T08:23:52.023003Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:52.023024Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:52.023187Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 29 partNo 0 count 1 size 1048780
2025-10-31T08:23:52.048297Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 29 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.048393Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:52.048455Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:52.048484Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.048544Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 0, Offset: 29 is stored on disk
2025-10-31T08:23:52.048565Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.048593Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 1, Offset: 29 is stored on disk
2025-10-31T08:23:52.048618Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.048644Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 29, partNo: 2, Offset: 29 is stored on disk
2025-10-31T08:23:52.049361Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.049388Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.049406Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.049458Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:52.049566Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:52.050516Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:52.050191Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.052305Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298718116985415:3740] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 29
    Offset: 29
    PartNo: 0
    WriteTimestampMS: 1761899031991
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 56
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:52.054872Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:52.055599Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298722411952727:3747], now have 1 active actors on pipe
2025-10-31T08:23:52.056124Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:52.056161Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:52.056290Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b201fc3d-3700168-169c84e-c7e98050_30 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:52.056328Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.056348Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.056364Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:52.056417Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.056468Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:52.056530Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:52.057341Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:52.058393Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298722411952727:3747] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b201fc3d-3700168-169c84e-c7e98050_30"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b201fc3d-3700168-169c84e-c7e98050_30"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 30
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:52.120369Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.120401Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.120414Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.120500Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298722411952730:3749], now have 1 active actors on pipe
2025-10-31T08:23:52.117604Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:52.127336Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:52.127393Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:52.128084Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:52.128695Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:52.128733Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:52.128764Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 30 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:52.129267Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:52.129325Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.129355Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.129366Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:52.129503Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 0
2025-10-31T08:23:52.129545Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 1
2025-10-31T08:23:52.129564Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 2
2025-10-31T08:23:52.162210Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 30 partNo 2 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 1048790 count 1 nextOffset 31 batches 3
2025-10-31T08:23:52.162347Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.163835Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 30,1 HeadOffset 30 endOffset 30 curOffset 31 d0000000000_00000000000000000030_00000_0000000001_00002? size 1048780 WTime 1761899032159
2025-10-31T08:23:52.165232Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:52.165420Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 1 size 1048780
2025-10-31T08:23:52.182289Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.182349Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:52.182401Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:52.182428Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.182474Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 0, Offset: 30 is stored on disk
2025-10-31T08:23:52.182489Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.182503Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.182526Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 1, Offset: 30 is stored on disk
2025-10-31T08:23:52.182549Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.182572Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 30, partNo: 2, Offset: 30 is stored on disk
2025-10-31T08:23:52.183216Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.183235Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.183252Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.183297Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:52.183389Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:52.183609Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 30
    Offset: 30
    PartNo: 0
    WriteTimestampMS: 1761899032127
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 52
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:52.189857Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298722411952730:3749] destroyed
2025-10-31T08:23:52.190029Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:52.190837Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298722411952740:3755], now have 1 active actors on pipe
2025-10-31T08:23:52.191305Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:52.191355Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:52.191491Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|16e28437-1652ace8-b3baa96a-fe1c06c2_31 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:52.191533Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.191554Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.191569Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:52.191626Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.191680Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:52.191748Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:52.192109Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|16e28437-1652ace8-b3baa96a-fe1c06c2_31"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:52.196258Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298722411952740:3755] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|16e28437-1652ace8-b3baa96a-fe1c06c2_31"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 31
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:52.223995Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.224036Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.224051Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.243113Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:52.243838Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298722411952742:3756], now have 1 active actors on pipe
2025-10-31T08:23:52.249240Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:52.249302Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:52.249837Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:52.253568Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:52.253632Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:52.253678Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 31 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:52.254103Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:52.254171Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.254201Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.254214Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:52.254365Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 0
2025-10-31T08:23:52.254415Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 1
2025-10-31T08:23:52.254433Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 2
2025-10-31T08:23:52.266908Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 31 partNo 2 FormedBlobsCount 0 NewHead: Offset 31 PartNo 0 PackedSize 1048790 count 1 nextOffset 32 batches 3
2025-10-31T08:23:52.267006Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.272378Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 31,1 HeadOffset 31 endOffset 31 curOffset 32 d0000000000_00000000000000000031_00000_0000000001_00002? size 1048780 WTime 1761899032271
2025-10-31T08:23:52.273545Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:52.273758Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 31 partNo 0 count 1 size 1048780
2025-10-31T08:23:52.296254Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 31 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.296342Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:52.296403Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:52.296429Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.296477Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 0, Offset: 31 is stored on disk
2025-10-31T08:23:52.296496Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.296522Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 1, Offset: 31 is stored on disk
2025-10-31T08:23:52.296547Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:52.296572Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 31, partNo: 2, Offset: 31 is stored on disk
2025-10-31T08:23:52.297176Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.297194Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.297208Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.297254Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000024_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297268Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297282Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000026_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297298Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297313Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297328Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000029_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297341Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297356Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000031_00000_0000000001_00002? (1048780)
2025-10-31T08:23:52.297370Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-10-31T08:23:52.297470Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:52.297529Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-10-31T08:23:52.297553Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000024_00000_0000000001_00002?
2025-10-31T08:23:52.297748Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000001_00002?
2025-10-31T08:23:52.297917Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000026_00000_0000000001_00002?
2025-10-31T08:23:52.298098Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000001_00002?
2025-10-31T08:23:52.298227Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00000_0000000001_00002?
2025-10-31T08:23:52.298479Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000029_00000_0000000001_00002?
2025-10-31T08:23:52.298593Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000001_00002?
2025-10-31T08:23:52.298699Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000031_00000_0000000001_00002?
2025-10-31T08:23:52.298816Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-10-31T08:23:52.298873Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 24 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:52.298894Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:52.298915Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 26 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:52.298935Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:52.298957Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 28 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:52.298974Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 29 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:52.000000Z
2025-10-31T08:23:52.298992Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:52.000000Z
2025-10-31T08:23:52.299013Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 31 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:52.000000Z
2025-10-31T08:23:52.299050Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-10-31T08:23:52.299155Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-31T08:23:52.299197Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000024_00000_0000000001_00002?
2025-10-31T08:23:52.299212Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.299235Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000024_00000_0000000001_00002?, parameters.CurOffset=24
2025-10-31T08:23:52.301708Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:52.301052Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.301128Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301157Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301183Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301209Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301235Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301260Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301303Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:52.301348Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63'
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 31
    Offset: 31
    PartNo: 0
    WriteTimestampMS: 1761899032252
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 43
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
>>>>> 1
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:52.306199Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 24.0/3
2025-10-31T08:23:52.306263Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 0
2025-10-31T08:23:52.306287Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 24:0 appended
2025-10-31T08:23:52.307396Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 24.1/3
2025-10-31T08:23:52.307428Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 1
2025-10-31T08:23:52.307448Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 24:1 appended
2025-10-31T08:23:52.307677Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 24.2/3
2025-10-31T08:23:52.307698Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 24 partNo 2
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 0
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-10-31T08:23:52.313540Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:52.322793Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 24 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 1048790 count 1 nextOffset 25 batches 3
2025-10-31T08:23:52.328042Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 24:2 appended
2025-10-31T08:23:52.328106Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000025_00000_0000000001_00002?
2025-10-31T08:23:52.328121Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.328147Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000025_00000_0000000001_00002?, parameters.CurOffset=25
2025-10-31T08:23:52.329372Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 25.0/3
2025-10-31T08:23:52.329416Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 0
2025-10-31T08:23:52.329434Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 25:0 appended
2025-10-31T08:23:52.330811Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 25.1/3
2025-10-31T08:23:52.330839Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 1
2025-10-31T08:23:52.330855Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 25:1 appended
2025-10-31T08:23:52.331094Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 25.2/3
2025-10-31T08:23:52.331111Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 25 partNo 2
2025-10-31T08:23:52.354379Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 25 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 2097545 count 2 nextOffset 26 batches 5
2025-10-31T08:23:52.354459Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 25:2 appended
2025-10-31T08:23:52.354504Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000026_00000_0000000001_00002?
2025-10-31T08:23:52.354518Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.354543Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000026_00000_0000000001_00002?, parameters.CurOffset=26
2025-10-31T08:23:52.355785Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 26.0/3
2025-10-31T08:23:52.355841Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 0
2025-10-31T08:23:52.355859Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 26:0 appended
2025-10-31T08:23:52.358088Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 26.1/3
2025-10-31T08:23:52.358120Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 1
2025-10-31T08:23:52.358138Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 26:1 appended
2025-10-31T08:23:52.358351Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 26.2/3
2025-10-31T08:23:52.358370Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 26 partNo 2
2025-10-31T08:23:52.364807Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 26 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 3146300 count 3 nextOffset 27 batches 7
2025-10-31T08:23:52.364886Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 26:2 appended
2025-10-31T08:23:52.364925Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000027_00000_0000000001_00002?
2025-10-31T08:23:52.364938Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.364962Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000027_00000_0000000001_00002?, parameters.CurOffset=27
2025-10-31T08:23:52.366314Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 27.0/3
2025-10-31T08:23:52.366365Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 0
2025-10-31T08:23:52.366385Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 27:0 appended
2025-10-31T08:23:52.368015Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 27.1/3
2025-10-31T08:23:52.368044Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 1
2025-10-31T08:23:52.368061Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 27:1 appended
2025-10-31T08:23:52.368309Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 27.2/3
2025-10-31T08:23:52.368328Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 27 partNo 2
2025-10-31T08:23:52.385471Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 27 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 4195055 count 4 nextOffset 28 batches 9
2025-10-31T08:23:52.385549Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 27:2 appended
2025-10-31T08:23:52.385591Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000028_00000_0000000001_00002?
2025-10-31T08:23:52.385606Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.385629Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000028_00000_0000000001_00002?, parameters.CurOffset=28
2025-10-31T08:23:52.386668Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 28.0/3
2025-10-31T08:23:52.386707Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 0
2025-10-31T08:23:52.386726Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 28:0 appended
2025-10-31T08:23:52.387847Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 28.1/3
2025-10-31T08:23:52.387876Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 1
2025-10-31T08:23:52.391964Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 28:1 appended
2025-10-31T08:23:52.392242Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 28.2/3
2025-10-31T08:23:52.392271Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 28 partNo 2
2025-10-31T08:23:52.395366Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 28 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 5243810 count 5 nextOffset 29 batches 11
2025-10-31T08:23:52.395420Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 28:2 appended
2025-10-31T08:23:52.435210Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000029_00000_0000000001_00002?
2025-10-31T08:23:52.435265Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.435291Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000029_00000_0000000001_00002?, parameters.CurOffset=29
2025-10-31T08:23:52.440703Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 29.0/3
2025-10-31T08:23:52.440772Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 0
2025-10-31T08:23:52.440796Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 29:0 appended
2025-10-31T08:23:52.447206Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 29.1/3
2025-10-31T08:23:52.447264Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 1
2025-10-31T08:23:52.447287Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 29:1 appended
2025-10-31T08:23:52.447553Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 29.2/3
2025-10-31T08:23:52.447575Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 29 partNo 2
2025-10-31T08:23:52.468676Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 29 partNo 2 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 6292565 count 6 nextOffset 30 batches 13
2025-10-31T08:23:52.468764Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 29:2 appended
2025-10-31T08:23:52.468807Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000030_00000_0000000001_00002?
2025-10-31T08:23:52.468820Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.468845Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000030_00000_0000000001_00002?, parameters.CurOffset=30
2025-10-31T08:23:52.470044Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 30.0/3
2025-10-31T08:23:52.470083Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 0
2025-10-31T08:23:52.470102Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 30:0 appended
2025-10-31T08:23:52.471477Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 30.1/3
2025-10-31T08:23:52.471507Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 1
2025-10-31T08:23:52.471524Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 30:1 appended
2025-10-31T08:23:52.471791Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 30.2/3
2025-10-31T08:23:52.471812Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 30 partNo 2
2025-10-31T08:23:52.648017Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 30 partNo 2 result is x0000000000_00000000000000000023_00000_0000000007_00016 size 8365364
2025-10-31T08:23:52.648100Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000023_00000_0000000007_00016 new key d0000000000_00000000000000000023_00000_0000000007_00016 size 8365364 WTime 1761899032647
2025-10-31T08:23:52.651779Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 30 partNo 2 FormedBlobsCount 1 NewHead: Offset 30 PartNo 2 PackedSize 24736 count 1 nextOffset 31 batches 1
2025-10-31T08:23:52.651842Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 30:2 appended
2025-10-31T08:23:52.651900Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000031_00000_0000000001_00002?
2025-10-31T08:23:52.651914Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:52.651940Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000031_00000_0000000001_00002?, parameters.CurOffset=31
2025-10-31T08:23:52.652949Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 31.0/3
2025-10-31T08:23:52.652987Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 0
2025-10-31T08:23:52.653007Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 31:0 appended
2025-10-31T08:23:52.654212Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 31.1/3
2025-10-31T08:23:52.654239Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 1
2025-10-31T08:23:52.654256Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 31:1 appended
2025-10-31T08:23:52.654510Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 31.2/3
2025-10-31T08:23:52.654529Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 31 partNo 2
2025-10-31T08:23:52.667552Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 31 partNo 2 FormedBlobsCount 0 NewHead: Offset 30 PartNo 2 PackedSize 1073491 count 2 nextOffset 32 batches 3
2025-10-31T08:23:52.667627Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 31:2 appended
2025-10-31T08:23:52.668746Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 30,2 HeadOffset 23 endOffset 24 curOffset 32 d0000000000_00000000000000000030_00002_0000000002_00002| size 1073481 WTime 1761899032668
2025-10-31T08:23:52.670080Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298722411952742:3756] destroyed
2025-10-31T08:23:52.670131Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298722411952749:3762], now have 1 active actors on pipe
2025-10-31T08:23:52.670292Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:52.670325Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:52.676009Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.676049Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.676063Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.676145Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:52.676350Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 7 size 8365364
2025-10-31T08:23:52.676446Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 2 count 2 size 1073481
2025-10-31T08:23:52.676738Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 16 size 26214400 endOffset 32 max time lag 0ms effective offset 0
2025-10-31T08:23:52.677721Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 3 blobs, size 24121472 count 23 last offset 15, current partition end offset: 32
2025-10-31T08:23:52.678918Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-31T08:23:52.678993Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 7 parts_count 16 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.679028Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 2 count 8 parts_count 15 source 1 size 7878064 accessed 0 times before, last time 2025-10-31T08:23:50.000000Z
2025-10-31T08:23:52.679054Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878064 accessed 0 times before, last time 2025-10-31T08:23:51.000000Z
2025-10-31T08:23:52.679639Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0'
2025-10-31T08:23:52.679670Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-10-31T08:23:52.679717Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 7 parts_count 16
2025-10-31T08:23:52.680393Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 1 of 3 from KV
2025-10-31T08:23:52.739006Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 7 size 8365364 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.739052Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 2 size 1073481 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.739108Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:52.740106Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 1 parts 2 suffix '124' size 1048780
2025-10-31T08:23:52.740169Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2025-10-31T08:23:52.740204Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.740232Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 2 parts 2 suffix '124' size 1073481
2025-10-31T08:23:52.744699Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.744736Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.744751Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.744967Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:52.745027Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 1048780 cause it's been evicted from L2. Actual L1 size: 12
2025-10-31T08:23:52.745052Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 24 size 1048780 cause it's been evicted from L2. Actual L1 size: 11
2025-10-31T08:23:52.745069Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:52.745912Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:52.745952Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000024_00000_0000000001_00002?(+) to d0000000000_00000000000000000024_00000_0000000001_00002?(+)
2025-10-31T08:23:52.745964Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000001_00002?(+) to d0000000000_00000000000000000025_00000_0000000001_00002?(+)
2025-10-31T08:23:52.747999Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000026_00000_0000000001_00002?(+) to d0000000000_00000000000000000026_00000_0000000001_00002?(+)
2025-10-31T08:23:52.748046Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000001_00002?(+) to d0000000000_00000000000000000027_00000_0000000001_00002?(+)
2025-10-31T08:23:52.748059Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00000_0000000001_00002?(+) to d0000000000_00000000000000000028_00000_0000000001_00002?(+)
2025-10-31T08:23:52.748072Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000029_00000_0000000001_00002?(+) to d0000000000_00000000000000000029_00000_0000000001_00002?(+)
2025-10-31T08:23:52.748086Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00000_0000000001_00002?(+) to d0000000000_00000000000000000030_00000_0000000001_00002?(+)
2025-10-31T08:23:52.748098Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000031_00000_0000000001_00002?(+) to d0000000000_00000000000000000031_00000_0000000001_00002?(+)
2025-10-31T08:23:52.748111Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000001_00002|(+) to d0000000000_00000000000000000023_00000_0000000001_00002|(+)
2025-10-31T08:23:52.752892Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 25 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.752957Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 26 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.752994Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 27 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.753030Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 28 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.753063Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 29 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.753094Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 30 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.753128Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 31 count 1 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.753230Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:52.753285Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:52.753315Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.753330Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.753351Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.753392Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:52.754422Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.754928Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 26 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.755387Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.755787Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.756237Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 29 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.756679Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.757115Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 31 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:52.800199Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.800238Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.800254Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:52.800769Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-10-31T08:23:52.800805Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-31T08:23:52.800885Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 7 size 8365344 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:52.801092Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 3 blobs
2025-10-31T08:23:52.801155Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:52.801215Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365344
2025-10-31T08:23:52.821135Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.822331Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.824797Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:52.831867Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.837898Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:52.839937Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.843180Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:52.845315Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.846971Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:52.852563Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.854426Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:52.855951Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.864778Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:52.866484Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.866744Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:52.869285Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-10-31T08:23:52.869629Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:52.872525Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.873920Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.875352Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:52.876974Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.878430Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:52.879920Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.881472Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:52.882944Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.884657Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:52.886108Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.887604Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:52.889448Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.890858Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:52.892307Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.892563Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:52.893649Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.895359Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:52.895603Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:52.896153Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 7878064 cause it's been evicted from L2. Actual L1 size: 4
2025-10-31T08:23:52.896182Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:52.926031Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:52.926271Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:52.926287Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:52.926304Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:53.032008Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.032056Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.032083Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:53.132005Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.132044Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.132060Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:53.140921Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:53.176239Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298722411952749:3762] destroyed
CallPersQueueGRPC response:
2025-10-31T08:23:53.236016Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.236054Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.236070Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:53.260342Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:53.340163Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.340245Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.340274Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:53.444017Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.444056Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.444075Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 32
    Result {
      Offset: 0
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:53.544046Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.544091Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.544110Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
>>>>> 2
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 16
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-10-31T08:23:53.627014Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298726706920142:3815], now have 1 active actors on pipe
2025-10-31T08:23:53.627542Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:53.627581Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:53.627704Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--topic1' partition 0 user user offset 16 count 16 size 26214400 endOffset 32 max time lag 0ms effective offset 16
2025-10-31T08:23:53.628172Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 2 blobs, size 8365364 count 14 last offset 23, current partition end offset: 32
2025-10-31T08:23:53.626277Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:53.629522Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-31T08:23:53.629599Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878064 accessed 1 times before, last time 2025-10-31T08:23:52.000000Z
2025-10-31T08:23:53.629620Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 7 parts_count 16 source 1 size 8365364 accessed 0 times before, last time 2025-10-31T08:23:52.000000Z
2025-10-31T08:23:53.629673Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 2 blobs are from cache.
2025-10-31T08:23:53.629792Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 2 blobs
2025-10-31T08:23:53.632002Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-10-31T08:23:53.632035Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0'
2025-10-31T08:23:53.633830Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.635171Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.645356Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.672447Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.673755Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.674869Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.684105Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.685238Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.686419Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.687406Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.710000Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.717877Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.721115Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:53.722767Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.722977Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:53.726388Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.729836Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.730103Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:53.731595Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.733348Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.735189Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.738351Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.739624Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.740869Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.743530Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.746609Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.747849Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.750574Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.751769Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:53.752903Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:53.753744Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:53.756229Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-10-31T08:23:53.756731Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.756748Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.756763Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:53.757089Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:53.913076Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:53.913108Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:53.913122Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.009515Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.009547Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.009563Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.065945Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:54.112889Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.112920Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.112936Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.216055Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.216149Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.216186Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.220257Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298726706920142:3815] destroyed
CallPersQueueGRPC response:
2025-10-31T08:23:54.316709Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.316745Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.316762Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.420120Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.420159Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.420175Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.522293Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.522325Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.522340Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.624234Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.624267Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.624282Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 32
    Result {
      Offset: 16
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:54.726173Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:54.727134Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298731001887497:3849], now have 1 active actors on pipe
2025-10-31T08:23:54.727659Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:54.727698Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:54.727831Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|b2bc5ad2-8639a14b-3569d274-cba6cb78_32 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:54.727871Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.727908Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.727926Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:54.727978Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.728033Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:54.728096Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.728109Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.728123Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.728171Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:54.728697Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:54.730021Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298731001887497:3849] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|b2bc5ad2-8639a14b-3569d274-cba6cb78_32"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|b2bc5ad2-8639a14b-3569d274-cba6cb78_32"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 32
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:54.768054Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:54.770261Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298731001887499:3850], now have 1 active actors on pipe
2025-10-31T08:23:54.775124Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:54.775184Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:54.775778Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:54.776490Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:54.776524Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:54.776552Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 32 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:54.776981Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:54.777036Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.777064Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.777076Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:54.777206Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 0
2025-10-31T08:23:54.777257Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 1
2025-10-31T08:23:54.777276Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 2
2025-10-31T08:23:54.807649Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 32 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 1048790 count 1 nextOffset 33 batches 3
2025-10-31T08:23:54.807750Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.808822Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 32,1 HeadOffset 32 endOffset 32 curOffset 33 d0000000000_00000000000000000032_00000_0000000001_00002? size 1048780 WTime 1761899034807
2025-10-31T08:23:54.810015Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:54.810401Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 1 size 1048780
2025-10-31T08:23:54.824814Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:54.824900Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:54.824964Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:54.824991Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:54.825041Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 0, Offset: 32 is stored on disk
2025-10-31T08:23:54.825062Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:54.825087Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 1, Offset: 32 is stored on disk
2025-10-31T08:23:54.825111Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:54.825136Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 32, partNo: 2, Offset: 32 is stored on disk
2025-10-31T08:23:54.825577Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.825595Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.825611Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.825673Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:54.825724Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1186: [PQ: 72075186224037892] Topic 'rt3.dc1--topic1' counters. CacheSize 26731033 CachedBlobs 5
2025-10-31T08:23:54.825791Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:54.826370Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:54.826598Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 32
    Offset: 32
    PartNo: 0
    WriteTimestampMS: 1761899034775
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 46
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:54.831058Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:54.832212Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298731001887499:3850] destroyed
2025-10-31T08:23:54.832281Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298731001887504:3854], now have 1 active actors on pipe
2025-10-31T08:23:54.832337Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:54.832365Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:54.832427Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.832441Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.832456Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.832588Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|bbd3e0f9-5e3075e8-df1d2eff-5698f0f5_33 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:54.832980Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.833006Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.833019Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:54.833072Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.833127Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:54.833196Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:54.834673Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|bbd3e0f9-5e3075e8-df1d2eff-5698f0f5_33"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:54.840113Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298731001887504:3854] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|bbd3e0f9-5e3075e8-df1d2eff-5698f0f5_33"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 33
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:54.874422Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:54.878293Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298731001887506:3855], now have 1 active actors on pipe
2025-10-31T08:23:54.880056Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:54.880091Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:54.880611Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:54.881143Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:54.881180Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:54.881209Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 33 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:54.890743Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:54.890824Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.890851Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.890864Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:54.891006Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 0
2025-10-31T08:23:54.891056Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 1
2025-10-31T08:23:54.891073Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 2
2025-10-31T08:23:54.896964Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 33 partNo 2 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 1048790 count 1 nextOffset 34 batches 3
2025-10-31T08:23:54.897054Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.898172Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 33,1 HeadOffset 33 endOffset 33 curOffset 34 d0000000000_00000000000000000033_00000_0000000001_00002? size 1048780 WTime 1761899034895
2025-10-31T08:23:54.899271Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:54.899451Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 1 size 1048780
2025-10-31T08:23:54.911898Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:54.911977Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:54.912032Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:54.912063Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:54.912107Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 0, Offset: 33 is stored on disk
2025-10-31T08:23:54.912123Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:54.912147Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 1, Offset: 33 is stored on disk
2025-10-31T08:23:54.912169Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:54.912191Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 33, partNo: 2, Offset: 33 is stored on disk
2025-10-31T08:23:54.913149Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:54.922710Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:54.921089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.921128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.921142Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.921192Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:54.921300Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 33
    Offset: 33
    PartNo: 0
    WriteTimestampMS: 1761899034887
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 21
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:54.926646Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298731001887506:3855] destroyed
2025-10-31T08:23:54.927675Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:54.928374Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298731001887510:3858], now have 1 active actors on pipe
2025-10-31T08:23:54.928819Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:54.928854Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:54.928965Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|690c590a-7176c86b-38243311-f693c74_34 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:54.928998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.929016Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.929030Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:54.929081Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.929130Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:54.929193Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:54.929618Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:54.930476Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298731001887510:3858] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|690c590a-7176c86b-38243311-f693c74_34"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:54.935070Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.935098Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.935113Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|690c590a-7176c86b-38243311-f693c74_34"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 34
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:54.959585Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:54.961032Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298731001887516:3862], now have 1 active actors on pipe
2025-10-31T08:23:54.965896Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:54.965961Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:54.966525Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:54.967038Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:54.967076Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:54.967105Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 34 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:54.967577Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:54.967638Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:54.967666Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:54.967677Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:54.967806Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 0
2025-10-31T08:23:54.967848Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 1
2025-10-31T08:23:54.967867Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 2
2025-10-31T08:23:54.996375Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 34 partNo 2 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 1048790 count 1 nextOffset 35 batches 3
2025-10-31T08:23:54.996470Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:54.997487Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 34,1 HeadOffset 34 endOffset 34 curOffset 35 d0000000000_00000000000000000034_00000_0000000001_00002? size 1048780 WTime 1761899034995
2025-10-31T08:23:54.998624Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:54.998795Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 34 partNo 0 count 1 size 1048780
2025-10-31T08:23:55.021913Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 34 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:55.021998Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:55.022055Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:55.022080Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.022126Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 0, Offset: 34 is stored on disk
2025-10-31T08:23:55.022144Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.022166Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 1, Offset: 34 is stored on disk
2025-10-31T08:23:55.022189Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.022212Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 34, partNo: 2, Offset: 34 is stored on disk
2025-10-31T08:23:55.022844Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.022862Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.022875Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.022923Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:55.023007Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.023730Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 34
    Offset: 34
    PartNo: 0
    WriteTimestampMS: 1761899034964
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 3
    WriteTimeMs: 53
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:55.023538Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:55.028175Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.032169Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298731001887516:3862] destroyed
2025-10-31T08:23:55.032246Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854818:3867], now have 1 active actors on pipe
2025-10-31T08:23:55.032309Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.032339Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.032468Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|9fb2b86-99a55ef-35758c4c-272915e9_35 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:55.032511Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.032530Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.032542Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:55.032598Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.033018Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:55.032661Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:55.032732Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|9fb2b86-99a55ef-35758c4c-272915e9_35"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:55.040083Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854818:3867] destroyed
2025-10-31T08:23:55.040157Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.040173Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.040187Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|9fb2b86-99a55ef-35758c4c-272915e9_35"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 35
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:55.077018Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.077865Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854820:3868], now have 1 active actors on pipe
2025-10-31T08:23:55.082160Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.082214Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.082725Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:55.083197Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:55.083232Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:55.083261Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 35 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:55.083676Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:55.083729Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.083759Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.083771Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:55.087966Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 0
2025-10-31T08:23:55.088041Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 1
2025-10-31T08:23:55.088061Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 2
2025-10-31T08:23:55.109661Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 35 partNo 2 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 1048790 count 1 nextOffset 36 batches 3
2025-10-31T08:23:55.109756Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.110692Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 35,1 HeadOffset 35 endOffset 35 curOffset 36 d0000000000_00000000000000000035_00000_0000000001_00002? size 1048780 WTime 1761899035107
2025-10-31T08:23:55.112286Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:55.112464Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 1 size 1048780
2025-10-31T08:23:55.133346Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:55.132233Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:55.132310Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:55.132367Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:55.132392Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.132438Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 0, Offset: 35 is stored on disk
2025-10-31T08:23:55.132455Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.132467Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:55.132477Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 1, Offset: 35 is stored on disk
2025-10-31T08:23:55.132500Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.132523Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 35, partNo: 2, Offset: 35 is stored on disk
2025-10-31T08:23:55.133040Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.133053Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.133063Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.133095Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:55.133161Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 35
    Offset: 35
    PartNo: 0
    WriteTimestampMS: 1761899035080
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 7
    WriteTimeMs: 44
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:55.135815Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854820:3868] destroyed
2025-10-31T08:23:55.137740Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.140911Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854846:3879], now have 1 active actors on pipe
2025-10-31T08:23:55.144131Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.144149Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.144164Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.145856Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.145903Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.146023Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|61f3149e-2bb71739-fcc96bc8-c1a5d984_36 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:55.146056Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.146074Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.146088Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:55.146136Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.146179Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:55.146242Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.146694Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|61f3149e-2bb71739-fcc96bc8-c1a5d984_36"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:55.149281Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854846:3879] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|61f3149e-2bb71739-fcc96bc8-c1a5d984_36"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 36
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:55.180243Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.184081Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854853:3882], now have 1 active actors on pipe
2025-10-31T08:23:55.185933Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.185977Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.186586Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:55.187131Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:55.187175Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:55.187208Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 36 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:55.187681Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:55.187741Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.187772Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.187783Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:55.196137Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 0
2025-10-31T08:23:55.196235Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 1
2025-10-31T08:23:55.196257Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 2
2025-10-31T08:23:55.266151Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 36 partNo 2 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 1048790 count 1 nextOffset 37 batches 3
2025-10-31T08:23:55.266238Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.267519Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 36,1 HeadOffset 36 endOffset 36 curOffset 37 d0000000000_00000000000000000036_00000_0000000001_00002? size 1048780 WTime 1761899035264
2025-10-31T08:23:55.270543Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:55.270579Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:55.270776Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 1 size 1048780
2025-10-31T08:23:55.281729Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:55.281807Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:55.281866Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:55.281895Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.281942Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 0, Offset: 36 is stored on disk
2025-10-31T08:23:55.281958Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.281984Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 1, Offset: 36 is stored on disk
2025-10-31T08:23:55.282009Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.282033Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 36, partNo: 2, Offset: 36 is stored on disk
2025-10-31T08:23:55.282624Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.282643Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.282658Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.282701Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:55.282802Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.283326Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63' size 1048780
CallPersQueueGRPC response:
2025-10-31T08:23:55.283606Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:55.285759Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854853:3882] destroyed
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 36
    Offset: 36
    PartNo: 0
    WriteTimestampMS: 1761899035183
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 12
    WriteTimeMs: 85
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:55.292043Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.294399Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854857:3885], now have 1 active actors on pipe
2025-10-31T08:23:55.295242Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.295288Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.295436Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|cd4326c3-7c9d40b2-820a460c-c5d1251a_37 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:55.295480Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.295500Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.295515Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:55.295583Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.295638Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:55.295716Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.296449Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:55.298135Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854857:3885] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|cd4326c3-7c9d40b2-820a460c-c5d1251a_37"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|cd4326c3-7c9d40b2-820a460c-c5d1251a_37"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 37
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:55.346999Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.348879Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854882:3895], now have 1 active actors on pipe
2025-10-31T08:23:55.352628Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.352679Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.353221Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:55.353913Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:55.353961Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:55.353995Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 37 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:55.354399Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:55.354454Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.354484Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.354496Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:55.354645Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 0
2025-10-31T08:23:55.354690Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 1
2025-10-31T08:23:55.354708Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 2
2025-10-31T08:23:55.383475Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 37 partNo 2 FormedBlobsCount 0 NewHead: Offset 37 PartNo 0 PackedSize 1048790 count 1 nextOffset 38 batches 3
2025-10-31T08:23:55.383571Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.384739Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 37,1 HeadOffset 37 endOffset 37 curOffset 38 d0000000000_00000000000000000037_00000_0000000001_00002? size 1048780 WTime 1761899035380
2025-10-31T08:23:55.385910Z node 25 :PERSQUEUE DEBUG: partition.cpp:2235: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-31T08:23:55.385942Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:55.386147Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 37 partNo 0 count 1 size 1048780
2025-10-31T08:23:55.409590Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 37 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:55.409712Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:55.409773Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:55.409803Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.409856Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 0, Offset: 37 is stored on disk
2025-10-31T08:23:55.409875Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.409901Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 1, Offset: 37 is stored on disk
2025-10-31T08:23:55.409924Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.409949Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 37, partNo: 2, Offset: 37 is stored on disk
2025-10-31T08:23:55.410453Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.410490Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.410505Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.410553Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:55.410655Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.410844Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:55.411471Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 37
    Offset: 37
    PartNo: 0
    WriteTimestampMS: 1761899035352
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 51
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
2025-10-31T08:23:55.412877Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854882:3895] destroyed
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:55.417610Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.418620Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854887:3898], now have 1 active actors on pipe
2025-10-31T08:23:55.423733Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:55.419062Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.419102Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.419228Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|6b88a1a3-17d81ac6-92c59684-e25a24d5_38 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:55.419264Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.419282Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.419296Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:55.419357Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.419404Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:55.419470Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|6b88a1a3-17d81ac6-92c59684-e25a24d5_38"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:55.428635Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854887:3898] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|6b88a1a3-17d81ac6-92c59684-e25a24d5_38"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 38
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:55.494267Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.494307Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.494325Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.504824Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.510734Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854891:3900], now have 1 active actors on pipe
2025-10-31T08:23:55.515719Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.515778Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.516319Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:55.516793Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:55.516829Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:55.516863Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 38 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:55.517108Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:55.517164Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.517196Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.517209Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:55.517355Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 0
2025-10-31T08:23:55.517397Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 1
2025-10-31T08:23:55.517414Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 2
2025-10-31T08:23:55.540116Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 38 partNo 2 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 1048790 count 1 nextOffset 39 batches 3
2025-10-31T08:23:55.540208Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.541413Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 38,1 HeadOffset 38 endOffset 38 curOffset 39 d0000000000_00000000000000000038_00000_0000000001_00002? size 1048780 WTime 1761899035540
2025-10-31T08:23:55.543739Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:55.543983Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 0 count 1 size 1048780
2025-10-31T08:23:55.565295Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:55.565404Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:55.565463Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:55.565491Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.565541Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 0, Offset: 38 is stored on disk
2025-10-31T08:23:55.565558Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.565583Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 1, Offset: 38 is stored on disk
2025-10-31T08:23:55.565609Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.565635Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 38, partNo: 2, Offset: 38 is stored on disk
2025-10-31T08:23:55.566145Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.566164Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.566179Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.566226Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:193: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:55.566320Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.567226Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:55.567468Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:55.568493Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854891:3900] destroyed
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 38
    Offset: 38
    PartNo: 0
    WriteTimestampMS: 1761899035516
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 48
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdGetOwnership {
  }
}
2025-10-31T08:23:55.572114Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.573042Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854899:3907], now have 1 active actors on pipe
2025-10-31T08:23:55.573491Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.573539Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.573680Z node 25 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie default|ba7597c6-32ed290f-75b5c5a7-1cf44572_39 generated for partition 0 topic 'rt3.dc1--topic1' owner default
2025-10-31T08:23:55.573720Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.573737Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.573751Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-31T08:23:55.573803Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.573853Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-31T08:23:55.573921Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.574361Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdGetOwnershipResult {
    OwnerCookie: "default|ba7597c6-32ed290f-75b5c5a7-1cf44572_39"
    Status: Active
    SeqNo: 0
  }
}
CallPersQueueGRPC request to localhost:13378
2025-10-31T08:23:55.579503Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854899:3907] destroyed
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  OwnerCookie: "default|ba7597c6-32ed290f-75b5c5a7-1cf44572_39"
  CmdWrite {
    SourceId: "source1"
    SeqNo: 39
    Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:55.595283Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.596207Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854901:3908], now have 1 active actors on pipe
2025-10-31T08:23:55.596272Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.596287Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.596304Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.601528Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:55.601592Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:55.602132Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 0 messageNo: 0 size: 511959
2025-10-31T08:23:55.602646Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 1 messageNo: 0 size: 511959
2025-10-31T08:23:55.602683Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:1978: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 2 messageNo: 0 size: 24658
2025-10-31T08:23:55.602719Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2012: [PQ: 72075186224037892] got client message topic: rt3.dc1--topic1 partition: 0 SourceId: 'source1' SeqNo: 39 partNo : 2 messageNo: 0 size 24658 offset: -1
2025-10-31T08:23:55.603031Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-31T08:23:55.603089Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.603120Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.603133Z node 25 :PERSQUEUE DEBUG: partition.cpp:2269: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-10-31T08:23:55.603292Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 0
2025-10-31T08:23:55.603339Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 1
2025-10-31T08:23:55.603358Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 2
2025-10-31T08:23:55.623428Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId 'source1' seqNo 39 partNo 2 FormedBlobsCount 0 NewHead: Offset 39 PartNo 0 PackedSize 1048790 count 1 nextOffset 40 batches 3
2025-10-31T08:23:55.623501Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.625045Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 39,1 HeadOffset 39 endOffset 39 curOffset 40 d0000000000_00000000000000000039_00000_0000000001_00002? size 1048780 WTime 1761899035623
2025-10-31T08:23:55.626077Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:55.626246Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 0 count 1 size 1048780
2025-10-31T08:23:55.648538Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdWriteResult {
    AlreadyWritten: false
    SourceId: "source1"
    SeqNo: 39
    Offset: 39
    PartNo: 0
    WriteTimestampMS: 1761899035601
    PartitionQuotedTimeMs: 0
    TotalTimeInPartitionQueueMs: 0
    WriteTimeMs: 39
    TopicQuotedTimeMs: 0
    WrittenInTx: false
  }
}
>>>>> 3
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 0
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-10-31T08:23:55.645999Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 39 count 1 size 1048780 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:55.646092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:55.646156Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 1048597 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:55.646186Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.646238Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 0, Offset: 39 is stored on disk
2025-10-31T08:23:55.646256Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.646283Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 1, Offset: 39 is stored on disk
2025-10-31T08:23:55.646307Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-31T08:23:55.646334Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: 'source1', Topic: 'rt3.dc1--topic1', Partition: 0, SeqNo: 39, partNo: 2, Offset: 39 is stored on disk
2025-10-31T08:23:55.646826Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:55.646846Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:55.646862Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:55.646919Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.646933Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.646950Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.646967Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.646985Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.646999Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000037_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.647014Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.647029Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:208: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00000_0000000001_00002? (1048780)
2025-10-31T08:23:55.647041Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:214: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 8390240 bytes
2025-10-31T08:23:55.647147Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:55.647212Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:230: [72075186224037892][Partition][0][StateIdle] Begin compaction for 8 blobs
2025-10-31T08:23:55.647239Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000001_00002?
2025-10-31T08:23:55.647436Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000001_00002?
2025-10-31T08:23:55.647618Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00000_0000000001_00002?
2025-10-31T08:23:55.647810Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00002?
2025-10-31T08:23:55.647958Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000001_00002?
2025-10-31T08:23:55.648210Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000037_00000_0000000001_00002?
2025-10-31T08:23:55.648235Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 2 parts 2 suffix '124' size 1073481
2025-10-31T08:23:55.648284Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:55.648338Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00000_0000000001_00002?
2025-10-31T08:23:55.648444Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:243: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00000_0000000001_00002?
2025-10-31T08:23:55.648553Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:267: [72075186224037892][Partition][0][StateIdle] Request 8 blobs for compaction
2025-10-31T08:23:55.648597Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 1073481 cause it's been evicted from L2. Actual L1 size: 11
2025-10-31T08:23:55.648615Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:55.648994Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:54.000000Z
2025-10-31T08:23:55.649029Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 33 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:54.000000Z
2025-10-31T08:23:55.649075Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 34 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:55.000000Z
2025-10-31T08:23:55.649120Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:55.000000Z
2025-10-31T08:23:55.649173Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 36 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:55.000000Z
2025-10-31T08:23:55.649216Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 37 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:55.000000Z
2025-10-31T08:23:55.649262Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 38 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:55.000000Z
2025-10-31T08:23:55.649310Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 39 partno 0 count 1 parts_count 2 source 1 size 1048780 accessed 0 times before, last time 2025-10-31T08:23:55.000000Z
2025-10-31T08:23:55.649367Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 8 blobs are from cache.
2025-10-31T08:23:55.649470Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:445: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-31T08:23:55.649518Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[0/8] d0000000000_00000000000000000032_00000_0000000001_00002?
2025-10-31T08:23:55.649534Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.649557Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000032_00000_0000000001_00002?, parameters.CurOffset=32
2025-10-31T08:23:55.650675Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 32.0/3
2025-10-31T08:23:55.650717Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 0
2025-10-31T08:23:55.650741Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 32:0 appended
2025-10-31T08:23:55.652883Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.652913Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.652944Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.652972Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.653003Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.653029Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.653056Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.653082Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63'
2025-10-31T08:23:55.653438Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:55.657025Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 32.1/3
2025-10-31T08:23:55.657074Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 1
2025-10-31T08:23:55.657104Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 32:1 appended
2025-10-31T08:23:55.657279Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 32.2/3
2025-10-31T08:23:55.657301Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 32 partNo 2
2025-10-31T08:23:55.754233Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 32 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 1048790 count 1 nextOffset 33 batches 3
2025-10-31T08:23:55.754324Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 32:2 appended
2025-10-31T08:23:55.754370Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[1/8] d0000000000_00000000000000000033_00000_0000000001_00002?
2025-10-31T08:23:55.754386Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.754430Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000033_00000_0000000001_00002?, parameters.CurOffset=33
2025-10-31T08:23:55.755459Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 33.0/3
2025-10-31T08:23:55.755514Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 0
2025-10-31T08:23:55.755531Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 33:0 appended
2025-10-31T08:23:55.756621Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 33.1/3
2025-10-31T08:23:55.756661Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 1
2025-10-31T08:23:55.756677Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 33:1 appended
2025-10-31T08:23:55.756908Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 33.2/3
2025-10-31T08:23:55.756926Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 33 partNo 2
2025-10-31T08:23:55.770191Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 33 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2097545 count 2 nextOffset 34 batches 5
2025-10-31T08:23:55.770268Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 33:2 appended
2025-10-31T08:23:55.770310Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[2/8] d0000000000_00000000000000000034_00000_0000000001_00002?
2025-10-31T08:23:55.770325Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.770354Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000034_00000_0000000001_00002?, parameters.CurOffset=34
2025-10-31T08:23:55.771379Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 34.0/3
2025-10-31T08:23:55.771418Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 0
2025-10-31T08:23:55.771436Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 34:0 appended
2025-10-31T08:23:55.773117Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 34.1/3
2025-10-31T08:23:55.773159Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 1
2025-10-31T08:23:55.773176Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 34:1 appended
2025-10-31T08:23:55.773303Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 34.2/3
2025-10-31T08:23:55.773322Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 34 partNo 2
2025-10-31T08:23:55.899709Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 34 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 3146300 count 3 nextOffset 35 batches 7
2025-10-31T08:23:55.899795Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 34:2 appended
2025-10-31T08:23:55.899842Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[3/8] d0000000000_00000000000000000035_00000_0000000001_00002?
2025-10-31T08:23:55.899858Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.899900Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000035_00000_0000000001_00002?, parameters.CurOffset=35
2025-10-31T08:23:55.900974Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 35.0/3
2025-10-31T08:23:55.901017Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 0
2025-10-31T08:23:55.901037Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 35:0 appended
2025-10-31T08:23:55.902193Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 35.1/3
2025-10-31T08:23:55.902223Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 1
2025-10-31T08:23:55.902239Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 35:1 appended
2025-10-31T08:23:55.902385Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 35.2/3
2025-10-31T08:23:55.902406Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 35 partNo 2
2025-10-31T08:23:55.908068Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 35 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 4195055 count 4 nextOffset 36 batches 9
2025-10-31T08:23:55.908124Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 35:2 appended
2025-10-31T08:23:55.908169Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[4/8] d0000000000_00000000000000000036_00000_0000000001_00002?
2025-10-31T08:23:55.908186Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.908213Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000036_00000_0000000001_00002?, parameters.CurOffset=36
2025-10-31T08:23:55.909243Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 36.0/3
2025-10-31T08:23:55.909282Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 0
2025-10-31T08:23:55.909299Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 36:0 appended
2025-10-31T08:23:55.910375Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 36.1/3
2025-10-31T08:23:55.910401Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 1
2025-10-31T08:23:55.910416Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 36:1 appended
2025-10-31T08:23:55.910587Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 36.2/3
2025-10-31T08:23:55.910606Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 36 partNo 2
2025-10-31T08:23:55.942079Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 36 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 5243810 count 5 nextOffset 37 batches 11
2025-10-31T08:23:55.942169Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 36:2 appended
2025-10-31T08:23:55.942216Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[5/8] d0000000000_00000000000000000037_00000_0000000001_00002?
2025-10-31T08:23:55.942230Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.942257Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000037_00000_0000000001_00002?, parameters.CurOffset=37
2025-10-31T08:23:55.943299Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 37.0/3
2025-10-31T08:23:55.943345Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 0
2025-10-31T08:23:55.943363Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 37:0 appended
2025-10-31T08:23:55.944588Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 37.1/3
2025-10-31T08:23:55.944632Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 1
2025-10-31T08:23:55.944649Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 37:1 appended
2025-10-31T08:23:55.944781Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 37.2/3
2025-10-31T08:23:55.944801Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 37 partNo 2
2025-10-31T08:23:55.950288Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 37 partNo 2 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 6292566 count 6 nextOffset 38 batches 13
2025-10-31T08:23:55.950360Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 37:2 appended
2025-10-31T08:23:55.950399Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[6/8] d0000000000_00000000000000000038_00000_0000000001_00002?
2025-10-31T08:23:55.950414Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:55.950439Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000038_00000_0000000001_00002?, parameters.CurOffset=38
2025-10-31T08:23:55.951398Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 38.0/3
2025-10-31T08:23:55.951434Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 0
2025-10-31T08:23:55.951450Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 38:0 appended
2025-10-31T08:23:55.952574Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 38.1/3
2025-10-31T08:23:55.952616Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 1
2025-10-31T08:23:56.014096Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:93: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob sourceId '' seqNo 38 partNo 1 result is x0000000000_00000000000000000030_00002_0000000008_00015 size 7878064
2025-10-31T08:23:56.014146Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 38:1 appended
2025-10-31T08:23:56.014333Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 38.2/3
2025-10-31T08:23:56.014361Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 38 partNo 2
2025-10-31T08:23:56.014429Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--topic1' partition 0 old key x0000000000_00000000000000000030_00002_0000000008_00015 new key d0000000000_00000000000000000030_00002_0000000008_00015 size 7878064 WTime 1761899036012
2025-10-31T08:23:56.052323Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 38 partNo 2 FormedBlobsCount 1 NewHead: Offset 38 PartNo 1 PackedSize 536763 count 1 nextOffset 39 batches 2
2025-10-31T08:23:56.052398Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 38:2 appended
2025-10-31T08:23:56.052437Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:478: [72075186224037892][Partition][0][StateIdle] key[7/8] d0000000000_00000000000000000039_00000_0000000001_00002?
2025-10-31T08:23:56.052452Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:508: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-31T08:23:56.052481Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:278: [72075186224037892][Partition][0][StateIdle] requestedBlob.Key=d0000000000_00000000000000000039_00000_0000000001_00002?, parameters.CurOffset=39
2025-10-31T08:23:56.053551Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 39.0/3
2025-10-31T08:23:56.053594Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 0
2025-10-31T08:23:56.053612Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 39:0 appended
2025-10-31T08:23:56.054710Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 39.1/3
2025-10-31T08:23:56.054736Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 1
2025-10-31T08:23:56.054755Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 39:1 appended
2025-10-31T08:23:56.054914Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:287: [72075186224037892][Partition][0][StateIdle] Try append part 39.2/3
2025-10-31T08:23:56.054933Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:58: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob processing sourceId 'source1' seqNo 39 partNo 2
2025-10-31T08:23:56.069545Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:136: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--topic1' partition 0 part blob complete sourceId '' seqNo 39 partNo 2 FormedBlobsCount 0 NewHead: Offset 38 PartNo 1 PackedSize 1585518 count 2 nextOffset 40 batches 4
2025-10-31T08:23:56.069621Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:367: [72075186224037892][Partition][0][StateIdle] Part 39:2 appended
2025-10-31T08:23:56.070634Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:637: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--topic1' partition 0 compactOffset 38,2 HeadOffset 30 endOffset 32 curOffset 40 d0000000000_00000000000000000038_00001_0000000002_00003| size 1585508 WTime 1761899036069
2025-10-31T08:23:56.072244Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854901:3908] destroyed
2025-10-31T08:23:56.072316Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298735296854906:3912], now have 1 active actors on pipe
2025-10-31T08:23:56.072426Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:56.072457Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:56.072523Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.072539Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.072553Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.072625Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:56.072829Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 2 count 8 size 7878064
2025-10-31T08:23:56.072924Z node 25 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 1 count 2 size 1585508
2025-10-31T08:23:56.073202Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--topic1' partition 0 user user offset 0 count 16 size 26214400 endOffset 40 max time lag 0ms effective offset 0
2025-10-31T08:23:56.073916Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 3 blobs, size 24121472 count 23 last offset 15, current partition end offset: 40
2025-10-31T08:23:56.073943Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-31T08:23:56.074012Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 7 parts_count 16 source 0 size 8365344 accessed 0 times before, last time 2025-10-31T08:23:52.000000Z
2025-10-31T08:23:56.074031Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 2 count 8 parts_count 15 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:56.074054Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878064 accessed 2 times before, last time 2025-10-31T08:23:53.000000Z
2025-10-31T08:23:56.074088Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 6. Have to read 1 of 3 from KV
2025-10-31T08:23:56.074159Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0'
2025-10-31T08:23:56.074193Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-10-31T08:23:56.074215Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 2 count 8 parts_count 15
2025-10-31T08:23:56.189687Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.189725Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.189740Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.189796Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-10-31T08:23:56.189810Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-31T08:23:56.189856Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 8 size 7878064 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:56.190108Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 3 blobs
2025-10-31T08:23:56.191734Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.192107Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2025-10-31T08:23:56.192167Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:56.197238Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.205299Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:56.206485Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.207735Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:56.209328Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.210599Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:56.211763Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.219127Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:56.220357Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.221667Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:56.222819Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.233283Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 7 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:56.234523Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.234702Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:56.237103Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-10-31T08:23:56.237462Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:56.241865Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.243072Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.244393Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:56.257048Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.258881Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:56.260064Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.261392Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:56.269330Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.271482Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:56.276501Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.281616Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:56.288015Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.289796Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:56.291060Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.291223Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:56.292745Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.295075Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:56.295367Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:56.296205Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 8365364 cause it's been evicted from L2. Actual L1 size: 11
2025-10-31T08:23:56.296227Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:56.305108Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.305135Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.305150Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.308087Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:56.442817Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 8 size 7878064 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:56.442872Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 2 size 1585508 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:56.442949Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.442965Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.442980Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.443026Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:56.445616Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.445653Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.445669Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.445863Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:56.445904Z node 25 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-31T08:23:56.445941Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00000_0000000001_00002?(+) to d0000000000_00000000000000000032_00000_0000000001_00002?(+)
2025-10-31T08:23:56.445953Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000033_00000_0000000001_00002?(+) to d0000000000_00000000000000000033_00000_0000000001_00002?(+)
2025-10-31T08:23:56.445965Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000034_00000_0000000001_00002?(+) to d0000000000_00000000000000000034_00000_0000000001_00002?(+)
2025-10-31T08:23:56.445978Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00000_0000000001_00002?(+) to d0000000000_00000000000000000035_00000_0000000001_00002?(+)
2025-10-31T08:23:56.445989Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000036_00000_0000000001_00002?(+) to d0000000000_00000000000000000036_00000_0000000001_00002?(+)
2025-10-31T08:23:56.446001Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000037_00000_0000000001_00002?(+) to d0000000000_00000000000000000037_00000_0000000001_00002?(+)
2025-10-31T08:23:56.446011Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000038_00000_0000000001_00002?(+) to d0000000000_00000000000000000038_00000_0000000001_00002?(+)
2025-10-31T08:23:56.446022Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000039_00000_0000000001_00002?(+) to d0000000000_00000000000000000039_00000_0000000001_00002?(+)
2025-10-31T08:23:56.446032Z node 25 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00002_0000000002_00002|(+) to d0000000000_00000000000000000030_00002_0000000002_00002|(+)
2025-10-31T08:23:56.452309Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452357Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452388Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452431Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452464Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452493Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 37 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452522Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452570Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:56.452616Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 39 partno 0 count 1 parts 2 suffix '63' size 1048780
2025-10-31T08:23:56.452647Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 7 parts 16 suffix '0' size 8365344
2025-10-31T08:23:56.452691Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 1 count 2 parts 3 suffix '124' size 1585508
2025-10-31T08:23:56.453444Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 1048780 cause it's been evicted from L2. Actual L1 size: 12
2025-10-31T08:23:56.453472Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 34 size 1048780 cause it's been evicted from L2. Actual L1 size: 11
2025-10-31T08:23:56.453488Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 35 size 1048780 cause it's been evicted from L2. Actual L1 size: 10
2025-10-31T08:23:56.453505Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8365344 cause it's been evicted from L2. Actual L1 size: 9
2025-10-31T08:23:56.453520Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 1048780 cause it's been evicted from L2. Actual L1 size: 8
2025-10-31T08:23:56.453533Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 37 size 1048780 cause it's been evicted from L2. Actual L1 size: 7
2025-10-31T08:23:56.453550Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 39 size 1048780 cause it's been evicted from L2. Actual L1 size: 6
2025-10-31T08:23:56.453565Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 1048780 cause it's been evicted from L2. Actual L1 size: 5
2025-10-31T08:23:56.453580Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 33 size 1048780 cause it's been evicted from L2. Actual L1 size: 4
2025-10-31T08:23:56.453596Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:56.536931Z node 25 :PERSQUEUE DEBUG: partition.cpp:2083: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-31T08:23:56.537011Z node 25 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-31T08:23:56.537040Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.537056Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.537069Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.537102Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:56.543547Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.543583Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.543598Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.644244Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.644284Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.644300Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.651452Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:56.725010Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298735296854906:3912] destroyed
CallPersQueueGRPC response:
2025-10-31T08:23:56.748512Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.748541Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.748553Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.852150Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.852187Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.852204Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 0
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
>>>>> 4
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 16
    Count: 16
    ReadTimestampMs: 0
  }
}
2025-10-31T08:23:56.951254Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298739591822273:3956], now have 1 active actors on pipe
2025-10-31T08:23:56.950659Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:56.951672Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:56.951698Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:56.951789Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--topic1' partition 0 user user offset 16 count 16 size 26214400 endOffset 40 max time lag 0ms effective offset 16
2025-10-31T08:23:56.952436Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 3 blobs, size 16243428 count 22 last offset 30, current partition end offset: 40
2025-10-31T08:23:56.953481Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-31T08:23:56.953535Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:56.953545Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:56.953555Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:56.953639Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878064 accessed 3 times before, last time 2025-10-31T08:23:56.000000Z
2025-10-31T08:23:56.953654Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 23 partno 0 count 7 parts_count 16 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:56.953669Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 2 count 8 parts_count 15 source 1 size 7878064 accessed 0 times before, last time 2025-10-31T08:23:56.000000Z
2025-10-31T08:23:56.953700Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 7. Have to read 1 of 3 from KV
2025-10-31T08:23:56.954126Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-10-31T08:23:56.954146Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0'
2025-10-31T08:23:56.954162Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 23 partno 0 count 7 parts_count 16
2025-10-31T08:23:57.008430Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037889 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 6] state 'Ready' dataSize 824 rowCount 2 cpuUsage 0.3536
2025-10-31T08:23:57.080634Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-10-31T08:23:57.080675Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-31T08:23:57.080718Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 23 count 7 size 8365364 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:57.080939Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.080954Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.080970Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.081065Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 3 blobs
2025-10-31T08:23:57.081212Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:57.081279Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0' size 8365364
2025-10-31T08:23:57.084415Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.085709Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.087192Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.093712Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.095106Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.096321Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.097612Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.106032Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.107467Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.108747Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.110109Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.111292Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.108698Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-10-31T08:23:57.108896Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 6 shard idx 72057594046644480:2 data size 824 row count 2
2025-10-31T08:23:57.109014Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037889 maps to shardIdx: 72057594046644480:2 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 6], pathId map=Cluster, is column=0, is olap=0, RowCount 2, DataSize 824
2025-10-31T08:23:57.109117Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037889 SplitByLoadNotEnabledForTable
2025-10-31T08:23:57.109428Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:57.113140Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 8 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:57.117949Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.118234Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 22 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:57.119991Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.121102Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.121351Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 23 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:57.131381Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.132728Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.134185Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.135462Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.136819Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.138152Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.139459Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.140757Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.142058Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.143295Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.146202Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.147465Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.147703Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:57.149782Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-10-31T08:23:57.152204Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:57.164617Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:57.164831Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:57.165118Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 7878064 cause it's been evicted from L2. Actual L1 size: 4
2025-10-31T08:23:57.165136Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:57.167366Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:57.240733Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.240769Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.240782Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.348018Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.348062Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.348080Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.356198Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037890 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 7] state 'Ready' dataSize 576 rowCount 1 cpuUsage 0.1253
2025-10-31T08:23:57.438935Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:57.449004Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.449044Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.449060Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.460360Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-10-31T08:23:57.460520Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 7 shard idx 72057594046644480:3 data size 576 row count 1
2025-10-31T08:23:57.460610Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037890 maps to shardIdx: 72057594046644480:3 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 7], pathId map=Topics, is column=0, is olap=0, RowCount 1, DataSize 576
2025-10-31T08:23:57.460723Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037890 SplitByLoadNotEnabledForTable
2025-10-31T08:23:57.461200Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:57.548407Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.548438Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.548455Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.568816Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298739591822273:3956] destroyed
2025-10-31T08:23:57.656060Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.656106Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.656126Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
2025-10-31T08:23:57.761995Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.762030Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.762048Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.866118Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.866155Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.866173Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:57.972208Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:57.972251Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:57.972269Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:58.076038Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.076081Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.076101Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 16
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:58.175850Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.175898Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.175913Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
>>>>> 5
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 9
    Count: 12
    ReadTimestampMs: 0
  }
}
2025-10-31T08:23:58.221516Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:58.227734Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298748181756939:3996], now have 1 active actors on pipe
2025-10-31T08:23:58.228442Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:58.228479Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:58.228602Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--topic1' partition 0 user user offset 9 count 12 size 26214400 endOffset 40 max time lag 0ms effective offset 9
2025-10-31T08:23:58.229047Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 2 blobs, size 7878064 count 14 last offset 15, current partition end offset: 40
2025-10-31T08:23:58.229071Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-31T08:23:58.229118Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 2 count 8 parts_count 15 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:58.229149Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 15 partno 1 count 8 parts_count 15 source 1 size 7878064 accessed 4 times before, last time 2025-10-31T08:23:56.000000Z
2025-10-31T08:23:58.229187Z node 25 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 8. Have to read 1 of 2 from KV
2025-10-31T08:23:58.230390Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 15 partno 1 count 8 parts 15 suffix '0'
2025-10-31T08:23:58.230413Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 2 count 8 parts_count 15
2025-10-31T08:23:58.260303Z node 25 :PERSQUEUE DEBUG: partition_compaction.cpp:183: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-31T08:23:58.278586Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.278627Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.278644Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:58.278694Z node 25 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-31T08:23:58.278708Z node 25 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-31T08:23:58.278749Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 8 size 7878064 actorID [25:7567298683941308119:2350]
2025-10-31T08:23:58.278940Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 2 blobs
2025-10-31T08:23:58.280385Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 1 count 2 parts 3 suffix '124' size 1585508
2025-10-31T08:23:58.280443Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 2 count 8 parts 15 suffix '0' size 7878064
2025-10-31T08:23:58.304886Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 8 count 1 size 536706 from pos 1 cbcount 2
2025-10-31T08:23:58.306078Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.307281Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.308965Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.310252Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.311560Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.313185Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.314400Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.315679Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 8 count 1 size 536707 from pos 0 cbcount 2
2025-10-31T08:23:58.317691Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.318956Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.320391Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.320604Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:58.321743Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.323609Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.323819Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:58.325166Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.326308Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.327746Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.337912Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.339559Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.343288Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.344746Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.346042Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.347376Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.362491Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:58.363859Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:58.364356Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 1585508 cause it's been evicted from L2. Actual L1 size: 4
2025-10-31T08:23:58.364376Z node 25 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--topic1, tablet id72075186224037892, cookie 0
2025-10-31T08:23:58.365113Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:58.372860Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037888 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 3] state 'Ready' dataSize 0 rowCount 0 cpuUsage 0.0336
2025-10-31T08:23:58.476403Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-10-31T08:23:58.476554Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 3 shard idx 72057594046644480:1 data size 0 row count 0
2025-10-31T08:23:58.476641Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037888 maps to shardIdx: 72057594046644480:1 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 3], pathId map=SourceIdMeta2, is column=0, is olap=0, RowCount 0, DataSize 0
2025-10-31T08:23:58.476732Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037888 SplitByLoadNotEnabledForTable
2025-10-31T08:23:58.477167Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:58.484940Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:58.499050Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.499092Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.499105Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC response:
2025-10-31T08:23:58.598357Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.598398Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.598413Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:58.605612Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298748181756939:3996] destroyed
2025-10-31T08:23:58.698384Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.698419Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.698435Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:58.800393Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.800431Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.800448Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:58.904009Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:58.904051Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:58.904069Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:58.921137Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:577: Got periodic table stats at tablet 72057594046644480 from shard 72075186224037891 followerId 0 pathId [OwnerId: 72057594046644480, LocalPathId: 8] state 'Ready' dataSize 712 rowCount 2 cpuUsage 0.4554
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 9
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:59.008000Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.008039Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.008055Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
>>>>> 6
CallPersQueueGRPC request to localhost:13378
PartitionRequest {
  Topic: "rt3.dc1--topic1"
  Partition: 0
  CmdRead {
    ClientId: "user"
    Offset: 25
    Count: 10
    ReadTimestampMs: 0
  }
}
2025-10-31T08:23:59.017071Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1382: proxy got request <none> IsMetaRequest 0 IsFetchRequest 0
2025-10-31T08:23:59.017919Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2723: [PQ: 72075186224037892] server connected, pipe [24:7567298752476724282:4023], now have 1 active actors on pipe
2025-10-31T08:23:59.024505Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 1
2025-10-31T08:23:59.024649Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:267: PersistSingleStats for pathId 8 shard idx 72057594046644480:4 data size 712 row count 2
2025-10-31T08:23:59.024731Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:292: TTxStoreTableStats.PersistSingleStats: main stats from datashardId(TabletID)=72075186224037891 maps to shardIdx: 72057594046644480:4 followerId=0, pathId: [OwnerId: 72057594046644480, LocalPathId: 8], pathId map=Versions, is column=0, is olap=0, RowCount 2, DataSize 712
2025-10-31T08:23:59.024822Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:483: Do not want to split tablet 72075186224037891 SplitByLoadNotEnabledForTable
2025-10-31T08:23:59.018462Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--topic1' requestId: <none>
2025-10-31T08:23:59.018496Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2637: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--topic1' partition 0
2025-10-31T08:23:59.018599Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:868: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--topic1' partition 0 user user offset 25 count 10 size 26214400 endOffset 40 max time lag 0ms effective offset 25
2025-10-31T08:23:59.019025Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1082: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 2 blobs, size 7878064 count 13 last offset 30, current partition end offset: 40
2025-10-31T08:23:59.020171Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:1108: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-31T08:23:59.020242Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 7 parts_count 16 source 0 size 8365364 accessed 0 times before, last time 2025-10-31T08:23:57.000000Z
2025-10-31T08:23:59.020267Z node 25 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 2 count 8 parts_count 15 source 1 size 7878064 accessed 1 times before, last time 2025-10-31T08:23:56.000000Z
2025-10-31T08:23:59.020309Z node 25 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 2 blobs are from cache.
2025-10-31T08:23:59.020434Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:574: FormAnswer for 2 blobs
2025-10-31T08:23:59.025539Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 7 parts 16 suffix '0'
2025-10-31T08:23:59.025575Z node 25 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 2 count 8 parts 15 suffix '0'
2025-10-31T08:23:59.032231Z node 24 :FLAT_TX_SCHEMESHARD DEBUG: schemeshard__table_stats.cpp:604: Started TEvPersistStats at tablet 72057594046644480, queue size# 0
2025-10-31T08:23:59.038979Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 24 totakecount 7 count 1 size 536706 from pos 1 cbcount 2
2025-10-31T08:23:59.049224Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.050542Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 25 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.051721Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.061315Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 26 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.062538Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.063803Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 27 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.073232Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.074563Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 28 totakecount 7 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.075689Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.075838Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 29 totakecount 7 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:59.098044Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 7 count 0 size 1024007 from pos 0 cbcount 2
2025-10-31T08:23:59.101690Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 30 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.102946Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.103123Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 31 totakecount 8 count 1 size 24704 from pos 0 cbcount 1
2025-10-31T08:23:59.104074Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 32 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.105129Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 32 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.120793Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 32 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.122162Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 33 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.123533Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 33 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.125421Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 34 totakecount 8 count 0 size 512005 from pos 0 cbcount 1
2025-10-31T08:23:59.126746Z node 25 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 34 totakecount 8 count 1 size 536706 from pos 0 cbcount 2
2025-10-31T08:23:59.127203Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.127218Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.127233Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:59.127454Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--topic1' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-31T08:23:59.298842Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.298877Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.298893Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:59.412650Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.412683Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.412698Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:59.447425Z node 24 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-10-31T08:23:59.515814Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.515858Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.515872Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:59.524041Z node 25 :PERSQUEUE DEBUG: pq_impl.cpp:2748: [PQ: 72075186224037892] server disconnected, pipe [24:7567298752476724282:4023] destroyed
CallPersQueueGRPC response:
2025-10-31T08:23:59.620087Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.620121Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.620136Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:59.720215Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.720250Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.720263Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:23:59.823390Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.823427Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.823442Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
Status: 1
ErrorCode: OK
PartitionResponse {
  CmdReadResult {
    MaxOffset: 40
    Result {
      Offset: 25
      Data: "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx...
(TRUNCATED)
2025-10-31T08:23:59.924741Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:23:59.924776Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:23:59.924790Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.028169Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.028216Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.028230Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.131556Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.131597Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.131614Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.236213Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.236246Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.236264Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.338102Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.338134Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.338147Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.440076Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.440112Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.440128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.575758Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.576097Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.576122Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.676086Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.676128Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.676146Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.776758Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.776796Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.776812Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-31T08:24:00.876348Z node 25 :PERSQUEUE DEBUG: partition.cpp:2256: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-31T08:24:00.876382Z node 25 :PERSQUEUE DEBUG: partition.cpp:2265: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-31T08:24:00.876398Z node 25 :PERSQUEUE DEBUG: partition.cpp:2288: [72075186224037892][Partition][0][StateIdle] Try persist
[[bad]]assertion failed at ydb/services/persqueue_v1/persqueue_ut.cpp:3295, virtual void NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext &): (info9.BlobsFromDisk == 0) failed: (1 != 0) [[rst]]
[[alt1]]TBackTrace::Capture()+28 (0x1B4466DC)
NUnitTest::NPrivate::RaiseError(char const*, TBasicString<char, std::__y1::char_traits<char>> const&, bool)+604 (0x1B9106FC)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TTestCaseCache::Execute_(NUnitTest::TTestContext&)+31183 (0x1AC2AE4F)
std::__y1::__function::__func<NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'(), std::__y1::allocator<NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()::'lambda'()>, void ()>::operator()()+280 (0x1AE63808)
TColoredProcessor::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool)+538 (0x1B9493DA)
NUnitTest::TTestBase::Run(std::__y1::function<void ()>, TBasicString<char, std::__y1::char_traits<char>> const&, char const*, bool)+504 (0x1B9173D8)
NKikimr::NPersQueueTests::NTestSuiteTPersQueueTest::TCurrentTest::Execute()+1229 (0x1AE6290D)
NUnitTest::TTestFactory::Execute()+2176 (0x1B918B90)
NUnitTest::RunMain(int, char**)+5805 (0x1B94323D)
??+0 (0x7F8470526D90)
__libc_start_main+128 (0x7F8470526E40)
_start+41 (0x182F8029)
[[rst]]
