2025-10-15T09:26:09.439320Z :PropagateSessionClosed INFO: Random seed for debugging is 1760520369439313
2025-10-15T09:26:09.593712Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561377411792217965:2154];send_to=[0:7307199536658146131:7762515];
2025-10-15T09:26:09.593730Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T09:26:09.595891Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T09:26:09.596482Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7561377410095913777:2160];send_to=[0:7307199536658146131:7762515];
2025-10-15T09:26:09.597243Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T09:26:09.597570Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/jdtg/0005ab/r3tmp/tmpY1Ppbo/pdisk_1.dat
2025-10-15T09:26:09.629181Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T09:26:09.635394Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T09:26:09.638193Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 11982, node 1
2025-10-15T09:26:09.648085Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/jdtg/0005ab/r3tmp/yandexnT8NWB.tmp
2025-10-15T09:26:09.648094Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/jdtg/0005ab/r3tmp/yandexnT8NWB.tmp
2025-10-15T09:26:09.648139Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/jdtg/0005ab/r3tmp/yandexnT8NWB.tmp
2025-10-15T09:26:09.648158Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T09:26:09.650638Z INFO: TTestServer started on Port 2718 GrpcPort 11982
TClient is connected to server localhost:2718
PQClient connected to localhost:11982
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T09:26:09.695287Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T09:26:09.695325Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T09:26:09.696775Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T09:26:09.698379Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T09:26:09.698394Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T09:26:09.699039Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-15T09:26:09.699425Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T09:26:09.699543Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-15T09:26:09.878562Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7561377410095913997:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.878584Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7561377410095913984:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.878600Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879037Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7561377410095914026:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879063Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879107Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7561377410095914030:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879128Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879218Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7561377411792218810:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879235Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879269Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7561377411792218823:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879275Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7561377411792218824:2329], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879280Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T09:26:09.879496Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-15T09:26:09.880254Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7561377411792218828:2601] txid# 281474976720661, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-15T09:26:09.882398Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7561377411792218827:2330], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-15T09:26:09.882413Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7561377410095914001:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-15T09:26:09.905375Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T09:26:09.908940Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T09:26:09.929696Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T09:26:09.937123Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7561377410095914097:2173] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-15T09:26:09.944430Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T09:26:09.949173Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7561377410095914111:2310], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T09:26:09.949246Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NzRlZGIzMGUtYTBmOTA5ZWUtZGFkOTg1ZWYtMWJkMjE2ZGI=, ActorId: [2:7561377410095913969:2294], ActorState: ExecuteState, TraceId: 01k7kk1xpp5by4py0a7dt5yh3c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T09:26:09.949635Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11982", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T09:26:09.967250Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7561377411792219309:2943] txid# 281474976720665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-15T09:26:09.974976Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k7kk1xs9bqgs8w7t8sdd93r7, Database: , SessionId: ydb://session/3?node_id=1&id=MmEzMWY4ZjEtYjZlMTBhZGMtZmY1YmE3MmEtNDQ5MTZmZDI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561377411792219352:2963] 
2025-10-15T09:26:10.595301Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T09:26:10.597340Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T09:26:14.594006Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561377411792217965:2154];send_to=[0:7307199536658146131:7762515];
2025-10-15T09:26:14.594035Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-15T09:26:14.596579Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7561377410095913777:2160];send_to=[0:7307199536658146131:7762515];
2025-10-15T09:26:14.596608Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-15T09:26:15.197527Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11982
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T09:26:15.216339Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11982
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720674
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T09:26:15.223162Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561377437562023552:3231] connected; active server actors: 1
2025-10-15T09:26:15.223291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T09:26:15.223397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T09:26:15.223666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T09:26:15.225697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T09:26:15.226164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T09:26:15.226218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T09:26:15.226237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T09:26:15.226254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T09:26:15.226321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023551:3230], now have 1 active actors on pipe
2025-10-15T09:26:15.226328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023574:2437], now have 1 active actors on pipe
2025-10-15T09:26:15.226396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T09:26:15.226495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T09:26:15.227224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T09:26:15.228473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023610:3278], now have 1 active actors on pipe
2025-10-15T09:26:15.228557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T09:26:15.229347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T09:26:15.229485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T09:26:15.229500Z node 2 :PERSQUEUE DEBUG: partition.cpp:1281: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T09:26:15.229534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T09:26:15.229576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561377435865718316:2392]
2025-10-15T09:26:15.230029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T09:26:15.230037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T09:26:15.230039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561377435865718316:2392]
2025-10-15T09:26:15.230044Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T09:26:15.230207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4311: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T09:26:15.230218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.230229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.230230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T09:26:15.230232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T09:26:15.230233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.230234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.230235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T09:26:15.230238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T09:26:15.230302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T09:26:15.230320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.231094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T09:26:15.231118Z node 2 :PERSQUEUE DEBUG: partition.cpp:1385: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760520375271, TxId 281474976720674
2025-10-15T09:26:15.231125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.231126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.231137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.231159Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.231580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.231626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.231634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.231635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.231637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.231640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.231715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T09:26:15.231729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T09:26:15.231755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T09:26:15.232647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T09:26:15.232666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T09:26:15.232840Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720675. Ctx: { TraceId: 01k7kk22xn78x0pwfb0e0ebtkb, Database: , SessionId: ydb://session/3?node_id=1&id=ZDNlN2NkZWQtZmY3N2M4MzMtYWViYzdkYjItNDM2NTFjYmU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-15T09:26:15.233034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720674
    CreateStep: 1760520375271
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720674
    CreateStep: 1760520375271
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11982
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T09:26:15.239601Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T09:26:15.240610Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T09:26:15.240850Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T09:26:15.240855Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11982
2025-10-15T09:26:15.241305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T09:26:15.241318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T09:26:15.242426Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T09:26:15.242649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T09:26:15.242681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37270
2025-10-15T09:26:15.242685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37270 proto=v1  topic=test-topic durationSec=0
2025-10-15T09:26:15.242689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T09:26:15.242985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T09:26:15.243018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T09:26:15.243023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T09:26:15.243024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T09:26:15.243028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T09:26:15.243412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T09:26:15.261043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T09:26:15.261110Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023713:2451] connected; active server actors: 1
2025-10-15T09:26:15.261124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T09:26:15.261126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T09:26:15.261161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023713:2451] disconnected.
2025-10-15T09:26:15.261166Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023713:2451] disconnected; active server actors: 1
2025-10-15T09:26:15.261168Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023713:2451] disconnected no session
2025-10-15T09:26:15.272326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T09:26:15.272340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T09:26:15.272342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561377437562023682:2451] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T09:26:15.272349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T09:26:15.272539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023736:2451], now have 1 active actors on pipe
2025-10-15T09:26:15.272606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T09:26:15.272669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.272681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.272700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d34bbc61-b42fd0-c2b0f766-45fc469d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T09:26:15.272707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.272710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.272711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T09:26:15.272718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.272731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T09:26:15.272745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.272889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.272894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.272902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.272973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d34bbc61-b42fd0-c2b0f766-45fc469d_0
2025-10-15T09:26:15.273241Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760520375273 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T09:26:15.273268Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d34bbc61-b42fd0-c2b0f766-45fc469d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T09:26:15.273373Z :INFO: [] MessageGroupId [src] SessionId [src|d34bbc61-b42fd0-c2b0f766-45fc469d_0] Write session: close. Timeout = 0 ms
2025-10-15T09:26:15.273386Z :INFO: [] MessageGroupId [src] SessionId [src|d34bbc61-b42fd0-c2b0f766-45fc469d_0] Write session will now close
2025-10-15T09:26:15.273391Z :DEBUG: [] MessageGroupId [src] SessionId [src|d34bbc61-b42fd0-c2b0f766-45fc469d_0] Write session: aborting
2025-10-15T09:26:15.273566Z :INFO: [] MessageGroupId [src] SessionId [src|d34bbc61-b42fd0-c2b0f766-45fc469d_0] Write session: gracefully shut down, all writes complete
2025-10-15T09:26:15.273571Z :DEBUG: [] MessageGroupId [src] SessionId [src|d34bbc61-b42fd0-c2b0f766-45fc469d_0] Write session: destroy
2025-10-15T09:26:15.273807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d34bbc61-b42fd0-c2b0f766-45fc469d_0 grpc read done: success: 0 data: 
2025-10-15T09:26:15.273816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d34bbc61-b42fd0-c2b0f766-45fc469d_0 grpc read failed
2025-10-15T09:26:15.273822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d34bbc61-b42fd0-c2b0f766-45fc469d_0 grpc closed
2025-10-15T09:26:15.273826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d34bbc61-b42fd0-c2b0f766-45fc469d_0 is DEAD
2025-10-15T09:26:15.274058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T09:26:15.274139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561377437562023736:2451] destroyed
2025-10-15T09:26:15.274147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T09:26:15.274150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.274151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.274152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-15T09:26:15.326802Z :INFO: [/Root] [] [25117c0e-d79688a5-e4f1d41b-3dce7050] Open read subsessions to databases: { name: dc1, endpoint: localhost:11982, path: /Root }, { name: dc2, endpoint: localhost:11982, path: /Invalid }
2025-10-15T09:26:15.328132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-15T09:26:15.328207Z :INFO: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] Starting read session
2025-10-15T09:26:15.328215Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] Starting single session
2025-10-15T09:26:15.328224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-15T09:26:15.328239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:11982
2025-10-15T09:26:15.328366Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.328370Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.328373Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T09:26:15.329613Z :INFO: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Starting read session
2025-10-15T09:26:15.329620Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Starting single session
2025-10-15T09:26:15.329650Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.329654Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.329657Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T09:26:15.329677Z :ERROR: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. 
2025-10-15T09:26:15.329682Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.329684Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.329705Z :INFO: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.330278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.330295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.330298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.386361Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Successfully connected. Initializing session
2025-10-15T09:26:15.386451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T09:26:15.386579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T09:26:15.386581Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T09:26:15.386587Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T09:26:15.386598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T09:26:15.386750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T09:26:15.386785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:34640
2025-10-15T09:26:15.386794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34640 proto=v1  topic=test-topic durationSec=0
2025-10-15T09:26:15.386801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T09:26:15.387168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T09:26:15.387203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T09:26:15.387209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T09:26:15.387210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T09:26:15.387215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T09:26:15.387753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T09:26:15.388331Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T09:26:15.388394Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read init: from# ipv6:[::1]:34640, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T09:26:15.388469Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 auth for : user
2025-10-15T09:26:15.388581Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Handle describe topics response
2025-10-15T09:26:15.388599Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 auth is DEAD
2025-10-15T09:26:15.388606Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 auth ok: topics# 1, initDone# 0
2025-10-15T09:26:15.388878Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T09:26:15.388944Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023769:2470] connected; active server actors: 1
2025-10-15T09:26:15.388954Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1704: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561377437562023769:2470] session shared/user_1_1_2446032429636071904_v1
2025-10-15T09:26:15.388961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T09:26:15.388973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T09:26:15.388983Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_2446032429636071904_v1" (Sender=[1:7561377437562023751:2470], Pipe=[1:7561377437562023769:2470], Partitions=[], ActiveFamilyCount=0)
2025-10-15T09:26:15.388990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T09:26:15.388998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T09:26:15.389008Z :INFO: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got InitResponse. ReadSessionId: shared/user_1_1_2446032429636071904_v1
2025-10-15T09:26:15.389009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_2446032429636071904_v1" (Sender=[1:7561377437562023751:2470], Pipe=[1:7561377437562023769:2470], Partitions=[], ActiveFamilyCount=0)
2025-10-15T09:26:15.389024Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T09:26:15.389022Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_2446032429636071904_v1" sender [1:7561377437562023751:2470] lock partition 0 for ReadingSession "shared/user_1_1_2446032429636071904_v1" (Sender=[1:7561377437562023751:2470], Pipe=[1:7561377437562023769:2470], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T09:26:15.389033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T09:26:15.389041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-15T09:26:15.389102Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.389219Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_2446032429636071904_v1" ClientId: "user" PipeClient { RawX1: 7561377437562023769 RawX2: 4503603922340262 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T09:26:15.389238Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T09:26:15.389287Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# a7132a0d-3b866f17-d2ec9384-58a4b4b9
2025-10-15T09:26:15.389309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T09:26:15.389451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023778:2477], now have 1 active actors on pipe
2025-10-15T09:26:15.389525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561377437562023778:2477]
2025-10-15T09:26:15.389552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T09:26:15.389597Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023779:2471] connected; active server actors: 1
2025-10-15T09:26:15.389606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T09:26:15.389610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T09:26:15.389603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.389616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.389637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_2446032429636071904_v1 on pipe: [1:7561377437562023778:2477]
2025-10-15T09:26:15.389660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.389669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.389671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T09:26:15.389682Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_2446032429636071904_v1:1 with generation 1
2025-10-15T09:26:15.389672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023779:2471] disconnected.
2025-10-15T09:26:15.389679Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023779:2471] disconnected; active server actors: 1
2025-10-15T09:26:15.389682Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561377437562023779:2471] disconnected no session
2025-10-15T09:26:15.389687Z node 2 :PERSQUEUE DEBUG: partition.cpp:3708: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_2446032429636071904_v1
2025-10-15T09:26:15.389694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.389718Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.390489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.390506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.390511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.390512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.390513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.390516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.390523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T09:26:15.390606Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760520375330 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T09:26:15.390619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T09:26:15.390638Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 sending to client partition status
2025-10-15T09:26:15.391779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T09:26:15.391789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T09:26:15.391792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561377437562023754:2471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T09:26:15.391798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T09:26:15.391960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023797:2471], now have 1 active actors on pipe
2025-10-15T09:26:15.391998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T09:26:15.392049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.392056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.392070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T09:26:15.392077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.392080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.392082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T09:26:15.392088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.392097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T09:26:15.392113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.392259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.392265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.392273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.392334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0
2025-10-15T09:26:15.392529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760520375392 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T09:26:15.392554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T09:26:15.394165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 1 to 1
2025-10-15T09:26:15.395904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.395917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T09:26:15.398550Z :INFO: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-15T09:26:15.399306Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-15T09:26:15.399415Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-15T09:26:15.399438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-15T09:26:15.399448Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-15T09:26:15.400530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.402074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 2 to 2
2025-10-15T09:26:15.402350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.402533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.402551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.402573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T09:26:15.402658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.403646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.403656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-15T09:26:15.406136Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T09:26:15.406149Z :DEBUG: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.406364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.406383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.406790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-15T09:26:15.407122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-15T09:26:15.407435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-15T09:26:15.407772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-15T09:26:15.407821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-15T09:26:15.407828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-15T09:26:15.407847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.407866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.407875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.407878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T09:26:15.407906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T09:26:15.407922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-15T09:26:15.407930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-15T09:26:15.407935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-15T09:26:15.407938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-15T09:26:15.408058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.408139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 3 to 3
2025-10-15T09:26:15.408421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-15T09:26:15.408438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.408528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760520375408
2025-10-15T09:26:15.409741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.409751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-15T09:26:15.409925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.410277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.410291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.410302Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.410315Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-15T09:26:15.410363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-15T09:26:15.410448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.411288Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.412017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.412505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.412517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.412868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-15T09:26:15.412932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-15T09:26:15.412979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-15T09:26:15.413049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-15T09:26:15.413076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-15T09:26:15.413081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-15T09:26:15.413095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.413111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.413524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.413677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.413689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.413704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-15T09:26:15.413764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.414009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.414026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.414043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.414044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.414048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.414056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T09:26:15.414059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.414063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-15T09:26:15.414065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.414069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-15T09:26:15.414071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.414075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-15T09:26:15.414078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.414084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-15T09:26:15.414131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T09:26:15.414142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T09:26:15.414157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.414170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.414177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T09:26:15.414193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T09:26:15.414207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-15T09:26:15.414214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-15T09:26:15.414217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-15T09:26:15.414221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-15T09:26:15.414203Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-15T09:26:15.414214Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-15T09:26:15.414233Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-15T09:26:15.414234Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 1
2025-10-15T09:26:15.414256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 4 to 4
2025-10-15T09:26:15.414245Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# 6625802-783a213-9a041f3d-85119c60, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.414266Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 6625802-783a213-9a041f3d-85119c60
2025-10-15T09:26:15.414616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-15T09:26:15.414630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.414712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760520375414
2025-10-15T09:26:15.415810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.415819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-15T09:26:15.416354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.416379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T09:26:15.416408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.416413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.416466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.416692Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.417058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.417069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.417154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-15T09:26:15.417205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-15T09:26:15.417222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 6 }
2025-10-15T09:26:15.417237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 1
2025-10-15T09:26:15.417256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-15T09:26:15.417304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-15T09:26:15.417328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-15T09:26:15.417331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-15T09:26:15.417344Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.417358Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-15T09:26:15.417380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.417394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.417425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T09:26:15.417436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-15T09:26:15.417439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T09:26:15.417467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.417476Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T09:26:15.417486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T09:26:15.417495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-15T09:26:15.417500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T09:26:15.417503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.417506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.417679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.417799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.418229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.418624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 5 to 5
2025-10-15T09:26:15.418699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.418865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.418873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-15T09:26:15.418887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.419027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.419060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.419075Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-15T09:26:15.419085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760520375407 queuesize 0 startOffset 0
2025-10-15T09:26:15.419097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.419106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.419162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.419657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.419902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.420019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.420142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.420224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.420262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.420288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.420322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.420420Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.422406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 6 to 6
2025-10-15T09:26:15.423126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-15T09:26:15.423194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.423211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.423226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.423227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.423232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.423239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T09:26:15.423246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.423249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-15T09:26:15.423251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.423256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-15T09:26:15.423258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.423261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-15T09:26:15.423266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.423270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-15T09:26:15.423492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.423863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.423880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.423883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T09:26:15.423902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T09:26:15.423910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-15T09:26:15.423916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-15T09:26:15.423919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-15T09:26:15.423922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-15T09:26:15.424001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.424010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-15T09:26:15.424408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-15T09:26:15.424426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.424610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1760520375424
2025-10-15T09:26:15.424891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.424935Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-15T09:26:15.424937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.424956Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.424971Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-15T09:26:15.425292Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375407 CreateTimestampMS: 1760520375392 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-15T09:26:15.425317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.425600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 1 }
2025-10-15T09:26:15.425614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 2
2025-10-15T09:26:15.425648Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-15T09:26:15.425667Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 6625802-783a213-9a041f3d-85119c60 has messages 1
2025-10-15T09:26:15.425705Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# 6625802-783a213-9a041f3d-85119c60, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-15T09:26:15.425720Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# 6625802-783a213-9a041f3d-85119c60
2025-10-15T09:26:15.426332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.426735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.426869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.426886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.426951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-15T09:26:15.427012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-15T09:26:15.427066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-15T09:26:15.427107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 7 to 7
2025-10-15T09:26:15.427415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-15T09:26:15.427444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-15T09:26:15.427452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-15T09:26:15.427481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.427486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.427493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.427504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.427519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-15T09:26:15.427584Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 0
2025-10-15T09:26:15.427596Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-15T09:26:15.427600Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-15T09:26:15.427608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.427625Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760520375407, sizeLag# 2253219
2025-10-15T09:26:15.427628Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 1
2025-10-15T09:26:15.428377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.428397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.428408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.428411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.428414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.428419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-15T09:26:15.428420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.428422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-15T09:26:15.428423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.428425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-15T09:26:15.428434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.428437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-15T09:26:15.428440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.428442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-15T09:26:15.428463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.428472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.428474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T09:26:15.428484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T09:26:15.428493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-15T09:26:15.428496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-15T09:26:15.428499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-15T09:26:15.428502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-15T09:26:15.428885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-15T09:26:15.428903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.428998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00004? size 2253219 WTime 1760520375428
2025-10-15T09:26:15.429021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.429031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-15T09:26:15.429156Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-15T09:26:15.429152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.429251Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-15T09:26:15.429263Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 2252976 to budget
2025-10-15T09:26:15.429293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.429346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-15T09:26:15.429388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.429406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.430161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 4 queued_in_partition_duration_ms: 6 }
2025-10-15T09:26:15.430172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 3
2025-10-15T09:26:15.430171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.430183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.430248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-15T09:26:15.430303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-15T09:26:15.430327Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-15T09:26:15.430343Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.430351Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-15T09:26:15.430358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-15T09:26:15.430411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-15T09:26:15.430417Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.430425Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.430437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-15T09:26:15.430445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-15T09:26:15.430459Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.430476Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 2253219
2025-10-15T09:26:15.430491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.430499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.430505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.430521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.430535Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-15T09:26:15.430571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-15T09:26:15.430594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.430595Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# fee23d84-8c22a551-3680b7a-1a35e1b1
2025-10-15T09:26:15.430613Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# 2bad49bc-51f3f472-8d7ec196-2994bf0b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.430636Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 2bad49bc-51f3f472-8d7ec196-2994bf0b
2025-10-15T09:26:15.430694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.430741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.430748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.430772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 3 max time lag 0ms effective offset 1
2025-10-15T09:26:15.430789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 3
2025-10-15T09:26:15.430795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-15T09:26:15.430805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.430813Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-15T09:26:15.430830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.430832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.430990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-15T09:26:15.392000Z WriteTime: 2025-10-15T09:26:15.407000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:34640", "logtype": "unknown", "_ip": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.431436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.431901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.432084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.432330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.432339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.432410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.433138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.433152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.433208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-15T09:26:15.433311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-15T09:26:15.433319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 8 to 8
2025-10-15T09:26:15.433421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-15T09:26:15.433562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.433570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-15T09:26:15.433802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-15T09:26:15.433831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-15T09:26:15.433838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-15T09:26:15.433854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.433861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.433873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T09:26:15.433896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.433907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.435426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-15T09:26:15.435753Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.436183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.436681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 2253219 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.436701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.436715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.436719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.436727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-15T09:26:15.436729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.436733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-15T09:26:15.436735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.436736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.436738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-15T09:26:15.436742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.436746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-15T09:26:15.436750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.436754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-15T09:26:15.436781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.436797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.436802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.436819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T09:26:15.436829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-15T09:26:15.436837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-15T09:26:15.436840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-15T09:26:15.436843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-15T09:26:15.436939Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375414 CreateTimestampMS: 1760520375400 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 1 }
2025-10-15T09:26:15.437170Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-15T09:26:15.437186Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 2 ReadGuid 2bad49bc-51f3f472-8d7ec196-2994bf0b has messages 1
2025-10-15T09:26:15.437225Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1760520375414, sizeLag# 2253329
2025-10-15T09:26:15.437234Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.437246Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# 2bad49bc-51f3f472-8d7ec196-2994bf0b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-15T09:26:15.437256Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# 2bad49bc-51f3f472-8d7ec196-2994bf0b
2025-10-15T09:26:15.437285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-15T09:26:15.437308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T09:26:15.437315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-15T09:26:15.437322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-15T09:26:15.437326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-15T09:26:15.437330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-15T09:26:15.437646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.438075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 9 to 9
2025-10-15T09:26:15.438153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-15T09:26:15.438169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.438253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,2 HeadOffset 4 endOffset 4 curOffset 6 d0000000000_00000000000000000004_00000_0000000002_00008? size 4506416 WTime 1760520375437
2025-10-15T09:26:15.438292Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.438808Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-15T09:26:15.438908Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-15T09:26:15.438934Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 2252978 to budget
2025-10-15T09:26:15.439437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.439943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.439955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-15T09:26:15.441199Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-15T09:26:15.441215Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.441224Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-15T09:26:15.441292Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.441299Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.441299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-15T09:26:15.441312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-15T09:26:15.441316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-15T09:26:15.441318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-15T09:26:15.441321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 9012876 bytes
2025-10-15T09:26:15.441350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-15T09:26:15.441392Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-15T09:26:15.441445Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# dccdebfd-1cfa988c-b10bf16a-857074dc
2025-10-15T09:26:15.441460Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# eebb5466-f3882acc-3042c9db-6343f5f0, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.441469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.441477Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid eebb5466-f3882acc-3042c9db-6343f5f0
2025-10-15T09:26:15.441677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 8 queued_in_partition_duration_ms: 1 }
2025-10-15T09:26:15.441688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 4
2025-10-15T09:26:15.442156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.442170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.442247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-15T09:26:15.442308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-15T09:26:15.400000Z WriteTime: 2025-10-15T09:26:15.414000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:34640", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.442369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-15T09:26:15.442422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-15T09:26:15.442463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-15T09:26:15.442473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-15T09:26:15.442804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.442496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.442505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.442514Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.442528Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 2 size 4506416
2025-10-15T09:26:15.442537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-15T09:26:15.442540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-15T09:26:15.442550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-15T09:26:15.442563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-15T09:26:15.442577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-15T09:26:15.442585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-15T09:26:15.442603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.442605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.442617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.442632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.442676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.442679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.442682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.442686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.442700Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-15T09:26:15.442727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-15T09:26:15.442732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.442738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.442741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.442744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.442753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.442757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.442886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T09:26:15.443015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-15T09:26:15.443142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-15T09:26:15.443268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-15T09:26:15.443342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-15T09:26:15.444015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.444192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-15T09:26:15.444214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.444655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T09:26:15.444912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 10 to 10
2025-10-15T09:26:15.445106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-15T09:26:15.445237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-15T09:26:15.445367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-15T09:26:15.445528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-15T09:26:15.445678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.446557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.446567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-15T09:26:15.446804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-15T09:26:15.446822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.447282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T09:26:15.447424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-15T09:26:15.447576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-15T09:26:15.447717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-15T09:26:15.447794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-15T09:26:15.448108Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.448305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-15T09:26:15.448326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.448461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T09:26:15.448757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-15T09:26:15.448892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-15T09:26:15.449027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-15T09:26:15.452412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 11 to 11
2025-10-15T09:26:15.454036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.454045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-15T09:26:15.456078Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.456551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-15T09:26:15.456639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-15T09:26:15.456660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760520375456
2025-10-15T09:26:15.456791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-15T09:26:15.456880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000003_00003_0000000001_00001| size 717134 WTime 1760520375456
2025-10-15T09:26:15.458081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.458097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.458163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-15T09:26:15.458224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-15T09:26:15.458299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-15T09:26:15.458676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-15T09:26:15.458709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-15T09:26:15.458718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-15T09:26:15.458748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.458756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.458783Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.458800Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-15T09:26:15.458813Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 1 size 717134
2025-10-15T09:26:15.458834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 4 max time lag 0ms effective offset 2
2025-10-15T09:26:15.458855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 4
2025-10-15T09:26:15.458862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-15T09:26:15.458867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.458884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.459014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 12 to 12
2025-10-15T09:26:15.459049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.459061Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-15T09:26:15.459075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-15T09:26:15.459091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.459103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.459188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.459700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.459845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.459993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.460132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.460232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.460318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-15T09:26:15.460355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 2 size 4506416 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.460392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T09:26:15.460604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.460613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-15T09:26:15.460668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.460924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.461727Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.462639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.462662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.462668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-15T09:26:15.462685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-15T09:26:15.462691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-15T09:26:15.462711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-15T09:26:15.462725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-15T09:26:15.462742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-15T09:26:15.462754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-15T09:26:15.462761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-15T09:26:15.462766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-15T09:26:15.462773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.462777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-15T09:26:15.462815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.462831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.462838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.462856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T09:26:15.462869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-15T09:26:15.462874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-15T09:26:15.462877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-15T09:26:15.462883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-15T09:26:15.463297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-15T09:26:15.463323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T09:26:15.463335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-15T09:26:15.463342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-15T09:26:15.463346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-15T09:26:15.463349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-15T09:26:15.463905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 4506426 count 2 nextOffset 8 batches 9
2025-10-15T09:26:15.463930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.464025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,2 HeadOffset 6 endOffset 6 curOffset 8 d0000000000_00000000000000000006_00000_0000000002_00008? size 4506416 WTime 1760520375463
2025-10-15T09:26:15.465151Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375423 CreateTimestampMS: 1760520375407 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 2 }
2025-10-15T09:26:15.465408Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-15T09:26:15.465433Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 3 ReadGuid eebb5466-f3882acc-3042c9db-6343f5f0 has messages 1
2025-10-15T09:26:15.465471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 13 to 13
2025-10-15T09:26:15.465462Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1760520375423, sizeLag# 2253329
2025-10-15T09:26:15.465473Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.465488Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# eebb5466-f3882acc-3042c9db-6343f5f0, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-15T09:26:15.465497Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# eebb5466-f3882acc-3042c9db-6343f5f0
2025-10-15T09:26:15.465816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.465825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-15T09:26:15.465853Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-15T09:26:15.465827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.466674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.466690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.466766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-15T09:26:15.466828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-15T09:26:15.467195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-15T09:26:15.467268Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.467307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-15T09:26:15.467345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-15T09:26:15.467354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-15T09:26:15.467405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.467412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.467434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-15T09:26:15.467462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-15T09:26:15.467473Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.467491Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 2 size 4506416
2025-10-15T09:26:15.467500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.467518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.467519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.467543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.467678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-15T09:26:15.467689Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-15T09:26:15.467732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.467753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 6 }
2025-10-15T09:26:15.467761Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-15T09:26:15.467765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 5
2025-10-15T09:26:15.467776Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 2252978 to budget
2025-10-15T09:26:15.467832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 3 }
2025-10-15T09:26:15.467837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 6
2025-10-15T09:26:15.468250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.468262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 717134 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.468279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.468294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T09:26:15.468306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-15T09:26:15.468400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.468412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.469102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.469378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.469566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.469579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.469649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-15T09:26:15.469699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-15T09:26:15.469749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-15T09:26:15.469805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-15T09:26:15.469836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-15T09:26:15.469842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-15T09:26:15.469859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.469863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.469869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.469886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.469896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-15T09:26:15.469960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.470622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 14 to 14
2025-10-15T09:26:15.471057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.471071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-15T09:26:15.471331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.471590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.471963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.471984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.472063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-15T09:26:15.472115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-15T09:26:15.472174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-15T09:26:15.472229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-15T09:26:15.472263Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-15T09:26:15.472276Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.472270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-15T09:26:15.472279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-15T09:26:15.472284Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-15T09:26:15.472316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.472322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.472328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.472340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.472344Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.472353Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.472458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-15T09:26:15.472469Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-15T09:26:15.472526Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# d46071ce-aeb0c7dc-a27bc138-7c43b576
2025-10-15T09:26:15.472545Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# bec598c5-63dfd86b-b7dfc251-73643a96, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.472564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.472573Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid bec598c5-63dfd86b-b7dfc251-73643a96
2025-10-15T09:26:15.472681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.472689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.472715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 524288 endOffset 6 max time lag 0ms effective offset 3
2025-10-15T09:26:15.472735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 0 count 0 last offset 0, current partition end offset: 6
2025-10-15T09:26:15.473045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
>>> Got event: 2025-10-15T09:26:15.473101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.473115Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-15T09:26:15.407000Z WriteTime: 2025-10-15T09:26:15.423000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:34640", "_ip": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.473132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 2 size 4506416 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.473138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0'
2025-10-15T09:26:15.473142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.473151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T09:26:15.473926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.474158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.475142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-15T09:26:15.475190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.475210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.475217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-15T09:26:15.475228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-15T09:26:15.475232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-15T09:26:15.475236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-15T09:26:15.475241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-15T09:26:15.475246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-15T09:26:15.475249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-15T09:26:15.475252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-15T09:26:15.475255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-15T09:26:15.475259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.475261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-15T09:26:15.475346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 15 to 15
2025-10-15T09:26:15.475439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.475452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.475455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T09:26:15.475468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T09:26:15.475476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-15T09:26:15.475478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-15T09:26:15.475480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-15T09:26:15.475482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-15T09:26:15.475860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2253229 count 1 nextOffset 9 batches 5
2025-10-15T09:26:15.475879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T09:26:15.475883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-15T09:26:15.475886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-15T09:26:15.475888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-15T09:26:15.475890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-15T09:26:15.476334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4506426 count 2 nextOffset 10 batches 9
2025-10-15T09:26:15.476354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T09:26:15.476359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-15T09:26:15.476362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-15T09:26:15.476365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-15T09:26:15.476368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-15T09:26:15.476826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.476834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-15T09:26:15.477174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 6759624 count 3 nextOffset 11 batches 13
2025-10-15T09:26:15.477189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.477276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 8,3 HeadOffset 8 endOffset 8 curOffset 11 d0000000000_00000000000000000008_00000_0000000003_00012? size 6759614 WTime 1760520375477
2025-10-15T09:26:15.477675Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.479572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 16 to 16
2025-10-15T09:26:15.480073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.480082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-15T09:26:15.480086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-10-15T09:26:15.480103Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.481094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-15T09:26:15.481104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-15T09:26:15.481106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012832 bytes
2025-10-15T09:26:15.482451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.482465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.482526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-15T09:26:15.482570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-15T09:26:15.482620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-15T09:26:15.482666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-15T09:26:15.482706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-15T09:26:15.482713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-15T09:26:15.482755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.482764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.482780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-15T09:26:15.482811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-15T09:26:15.482831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-15T09:26:15.482840Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.482851Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 3 size 6759614
2025-10-15T09:26:15.482858Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-15T09:26:15.482860Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-15T09:26:15.482862Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-15T09:26:15.482864Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00004?(+) to d0000000000_00000000000000000003_00000_0000000001_00004?(+)
2025-10-15T09:26:15.482869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.482870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-15T09:26:15.482876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-15T09:26:15.482882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.482887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.482899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.482915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.482938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.483140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 20 }
2025-10-15T09:26:15.483147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 7
2025-10-15T09:26:15.483151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275215[B]
2025-10-15T09:26:15.483222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 4 }
2025-10-15T09:26:15.483233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 8
2025-10-15T09:26:15.483348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.483363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.483375Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T09:26:15.483396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-15T09:26:15.483395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.483400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.483411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-15T09:26:15.483413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.483434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 17 to 17
2025-10-15T09:26:15.483443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.483451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.483452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.483581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T09:26:15.483700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.483709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-15T09:26:15.483727Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.483732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-15T09:26:15.483860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-15T09:26:15.483982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-15T09:26:15.484549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-15T09:26:15.484800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.485233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-15T09:26:15.485253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T09:26:15.485380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-15T09:26:15.485506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-15T09:26:15.485641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-15T09:26:15.485717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 18 to 18
2025-10-15T09:26:15.485710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-15T09:26:15.486131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-15T09:26:15.486147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.486248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T09:26:15.486297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.486378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-15T09:26:15.486510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-15T09:26:15.486644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-15T09:26:15.487138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.487146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-15T09:26:15.487152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528018[B] reached maximum (20971520[B])
2025-10-15T09:26:15.487171Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.487245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-15T09:26:15.488888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6759623 count 3 nextOffset 7 batches 13
2025-10-15T09:26:15.488910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T09:26:15.489030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-15T09:26:15.494605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-15T09:26:15.494748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-15T09:26:15.494891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-15T09:26:15.494967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-15T09:26:15.494981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760520375494
2025-10-15T09:26:15.495257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-15T09:26:15.495350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,1 HeadOffset 3 endOffset 4 curOffset 8 d0000000000_00000000000000000007_00001_0000000001_00003| size 1741188 WTime 1760520375495
2025-10-15T09:26:15.496329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.496343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.496405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-15T09:26:15.496452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-15T09:26:15.496505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-15T09:26:15.496737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-15T09:26:15.496769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-15T09:26:15.496777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-15T09:26:15.496801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.496807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.496830Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.496843Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-15T09:26:15.496850Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 1 size 1741188
2025-10-15T09:26:15.496863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.496878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.497040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 26214400 endOffset 8 max time lag 0ms effective offset 3
2025-10-15T09:26:15.497048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 0 blobs, size 0 count 0 last offset 3, current partition end offset: 8
2025-10-15T09:26:15.497139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. All data is from uncompacted head.
2025-10-15T09:26:15.497146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-15T09:26:15.497167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-15T09:26:15.497195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 3
2025-10-15T09:26:15.497277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.498652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.498671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.498677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.498681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.498689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 3 size 6759614 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.498744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.498753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.498768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.498772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758731 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.498775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.498780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T09:26:15.498789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 3 parts 12 suffix '63' size 6759614
2025-10-15T09:26:15.498792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-15T09:26:15.498796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-15T09:26:15.498788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.498803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-15T09:26:15.498811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-15T09:26:15.498837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-15T09:26:15.498844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-15T09:26:15.498851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-15T09:26:15.498860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-15T09:26:15.498869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-15T09:26:15.498877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-15T09:26:15.498883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-15T09:26:15.498889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-15T09:26:15.498895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-15T09:26:15.498901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-15T09:26:15.498907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.498911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-15T09:26:15.498954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.498977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.498981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.499006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T09:26:15.499022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-15T09:26:15.499025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-15T09:26:15.499028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-15T09:26:15.499032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-15T09:26:15.499086Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 8 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375428 CreateTimestampMS: 1760520375414 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 8295742 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 8 StartOffset: 0 } Cookie: 3 }
2025-10-15T09:26:15.499514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2253230 count 1 nextOffset 12 batches 5
2025-10-15T09:26:15.499542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T09:26:15.499548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-15T09:26:15.499558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-15T09:26:15.499581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-15T09:26:15.499584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-15T09:26:15.500242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.500197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4506428 count 2 nextOffset 13 batches 9
2025-10-15T09:26:15.500222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.500320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,2 HeadOffset 11 endOffset 11 curOffset 13 d0000000000_00000000000000000011_00000_0000000002_00008? size 4506418 WTime 1760520375500
2025-10-15T09:26:15.501161Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 8
2025-10-15T09:26:15.501186Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 8 ReadOffset 4 ReadGuid bec598c5-63dfd86b-b7dfc251-73643a96 has messages 1
2025-10-15T09:26:15.501212Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 8, WTime# 1760520375428, sizeLag# 8295742
2025-10-15T09:26:15.501223Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.501237Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# bec598c5-63dfd86b-b7dfc251-73643a96, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-15T09:26:15.501245Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# bec598c5-63dfd86b-b7dfc251-73643a96
2025-10-15T09:26:15.501825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.502584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.502599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.502710Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.502810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-15T09:26:15.502863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-15T09:26:15.502918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-15T09:26:15.502998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-15T09:26:15.503031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-15T09:26:15.503039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-15T09:26:15.503056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-15T09:26:15.503080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-15T09:26:15.503096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-15T09:26:15.503111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.503117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.503122Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.503134Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 2 size 4506418
2025-10-15T09:26:15.503143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.503166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.503188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.503168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.503193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.503229Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-15T09:26:15.503253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-15T09:26:15.503322Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-15T09:26:15.503316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.503337Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 2252978 to budget
2025-10-15T09:26:15.503361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 7 }
2025-10-15T09:26:15.503377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 9
2025-10-15T09:26:15.503382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275217[B]
2025-10-15T09:26:15.503452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 6 }
2025-10-15T09:26:15.503463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 10
2025-10-15T09:26:15.503743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 19 to 19
2025-10-15T09:26:15.504005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.504015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-15T09:26:15.504115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 4 }
2025-10-15T09:26:15.504124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 11
2025-10-15T09:26:15.504254Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-15T09:26:15.504269Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.504277Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-15T09:26:15.504351Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.504359Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.504475Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-15T09:26:15.504552Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# 7660c2ce-6e672422-f7f7c89b-7b7fe150
2025-10-15T09:26:15.504576Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# 7eae9610-26a5647a-fd68f50f-25d38718, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 4, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.504603Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 4 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 7eae9610-26a5647a-fd68f50f-25d38718
2025-10-15T09:26:15.504650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.505050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.505237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.505252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.505352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-15T09:26:15.414000Z WriteTime: 2025-10-15T09:26:15.428000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:34640", "logtype": "unknown", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.505483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-15T09:26:15.505540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-15T09:26:15.505591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-15T09:26:15.505654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-15T09:26:15.505665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-15T09:26:15.505697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.505705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.505718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.505720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.505728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.505747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.505778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-15T09:26:15.505801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 4 size 524288 endOffset 11 max time lag 0ms effective offset 4
2025-10-15T09:26:15.505824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 4506416 count 2 last offset 4, current partition end offset: 11
2025-10-15T09:26:15.505827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-15T09:26:15.505839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.505852Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-15T09:26:15.505853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.505866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.505873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.506028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.506170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.506306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.506456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.506649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T09:26:15.506793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.506933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.506983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.507074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.507153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.507234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.507816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.507830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.507891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-15T09:26:15.508163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-15T09:26:15.508213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-15T09:26:15.508270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-15T09:26:15.508301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-15T09:26:15.508309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-15T09:26:15.508341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-15T09:26:15.508496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.508505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.508512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.508528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.508935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 20 to 20
2025-10-15T09:26:15.509801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-15T09:26:15.510652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.510662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-15T09:26:15.510706Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.511096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.511242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.511253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1741188 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.511275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.511276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T09:26:15.511281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-15T09:26:15.511283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T09:26:15.511285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 1 parts 3 suffix '124' size 1741188
2025-10-15T09:26:15.511526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.511535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.511543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 717134 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.511545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.511548Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.512123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 2 size 4506418 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.512143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.512152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.512159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.512164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-15T09:26:15.512177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-15T09:26:15.512184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-15T09:26:15.512190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-15T09:26:15.512200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-15T09:26:15.512206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-15T09:26:15.512213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-15T09:26:15.512220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-15T09:26:15.512225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-15T09:26:15.512231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.512236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-15T09:26:15.512268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.512288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.512291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T09:26:15.512315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T09:26:15.512330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-15T09:26:15.512333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-15T09:26:15.512338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-15T09:26:15.512346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-15T09:26:15.512402Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 11 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375436 CreateTimestampMS: 1760520375418 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375437 CreateTimestampMS: 1760520375422 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 9013030 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 11 StartOffset: 0 } Cookie: 4 }
2025-10-15T09:26:15.512611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.512771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-15T09:26:15.512795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T09:26:15.512801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-15T09:26:15.512805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-15T09:26:15.512808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-15T09:26:15.512812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-15T09:26:15.512924Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 11
2025-10-15T09:26:15.512944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.512948Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 11 ReadOffset 6 ReadGuid 7eae9610-26a5647a-fd68f50f-25d38718 has messages 1
2025-10-15T09:26:15.512974Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 11, WTime# 1760520375437, sizeLag# 9013030
2025-10-15T09:26:15.512978Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.512989Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# 7eae9610-26a5647a-fd68f50f-25d38718, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505940
2025-10-15T09:26:15.512995Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# 7eae9610-26a5647a-fd68f50f-25d38718
2025-10-15T09:26:15.513343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 4506428 count 2 nextOffset 15 batches 9
2025-10-15T09:26:15.513366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T09:26:15.513373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-15T09:26:15.513376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-15T09:26:15.513379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-15T09:26:15.513382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-15T09:26:15.513936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 21 to 21
2025-10-15T09:26:15.514242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.514251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-15T09:26:15.514255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.514285Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.514276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 6759626 count 3 nextOffset 16 batches 13
2025-10-15T09:26:15.514302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.514398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 13,3 HeadOffset 13 endOffset 13 curOffset 16 d0000000000_00000000000000000013_00000_0000000003_00012? size 6759616 WTime 1760520375513
2025-10-15T09:26:15.516305Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.517454Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 4505940, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981652
2025-10-15T09:26:15.517529Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-15T09:26:15.517542Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 4505940 to budget
2025-10-15T09:26:15.517722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000003_00012?
2025-10-15T09:26:15.517732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000002_00008?
2025-10-15T09:26:15.517735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266032 bytes
2025-10-15T09:26:15.517768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-15T09:26:15.517792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-15T09:26:15.518029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.518055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.518233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 15 }
2025-10-15T09:26:15.518241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 12
2025-10-15T09:26:15.518244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.518284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 2 }
2025-10-15T09:26:15.518286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 13
2025-10-15T09:26:15.518476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 22 to 22
2025-10-15T09:26:15.518535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.518551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.518644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-15T09:26:15.518704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.518699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-15T09:26:15.518712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-15T09:26:15.518752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-15T09:26:15.518802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-15T09:26:15.518835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-15T09:26:15.518842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-15T09:26:15.518860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.518868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.518873Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.518886Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 3 size 6759616
2025-10-15T09:26:15.518895Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000002_00008?(+) to d0000000000_00000000000000000004_00000_0000000002_00008?(+)
2025-10-15T09:26:15.518896Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000002_00008?(+) to d0000000000_00000000000000000006_00000_0000000002_00008?(+)
2025-10-15T09:26:15.518898Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000001_00001|(+) to d0000000000_00000000000000000003_00003_0000000001_00001|(+)
2025-10-15T09:26:15.518904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.518906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000003_00012?
2025-10-15T09:26:15.518913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000002_00008?
2025-10-15T09:26:15.518919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.518922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.518935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.518982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 3 parts_count 12 source 1 size 6759614 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.518988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.518996Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T09:26:15.519016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-15T09:26:15.519017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 3 parts 12 suffix '63'
2025-10-15T09:26:15.519021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.519040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.519047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.519071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.519147Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-15T09:26:15.519160Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.519165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T09:26:15.519209Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-15T09:26:15.519224Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.519302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-15T09:26:15.519444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-15T09:26:15.519592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-15T09:26:15.519798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-15T09:26:15.418000Z WriteTime: 2025-10-15T09:26:15.436000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:34640", "logtype": "unknown", "server": "ipv6:[::1]:34640", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.520382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.520441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2253229 count 1 nextOffset 9 batches 5
2025-10-15T09:26:15.520468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T09:26:15.520599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-15T09:26:15.520638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.520751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-15T09:26:15.520899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-15T09:26:15.521082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-15T09:26:15.522602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 23 to 23
2025-10-15T09:26:15.522852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.522861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-15T09:26:15.522866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.522897Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.523109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4506426 count 2 nextOffset 10 batches 9
2025-10-15T09:26:15.523129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T09:26:15.523250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-15T09:26:15.523728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-15T09:26:15.523861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-15T09:26:15.524029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-15T09:26:15.528048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295601
2025-10-15T09:26:15.528068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295601 WTime 1760520375527
2025-10-15T09:26:15.528091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-15T09:26:15.528099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.528212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T09:26:15.528341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-15T09:26:15.528467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-15T09:26:15.528594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-15T09:26:15.528769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-15T09:26:15.529205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-15T09:26:15.529220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T09:26:15.529334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-15T09:26:15.529666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-15T09:26:15.529789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-15T09:26:15.529842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-15T09:26:15.530243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-15T09:26:15.530302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,3 HeadOffset 7 endOffset 8 curOffset 13 d0000000000_00000000000000000010_00004_0000000003_00008| size 4711504 WTime 1760520375529
2025-10-15T09:26:15.531695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.531708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.531771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-15T09:26:15.531822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-15T09:26:15.531871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-15T09:26:15.531919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-15T09:26:15.531940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-15T09:26:15.531946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-15T09:26:15.531964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.531969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.531990Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.532001Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295601
2025-10-15T09:26:15.532006Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 3 size 4711504
2025-10-15T09:26:15.532020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.532027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.532040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.532209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-15T09:26:15.532314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.532882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 2 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.532891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 2 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.532899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 3 size 6759616 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.532911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.532924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T09:26:15.532928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.532932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T09:26:15.532938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-15T09:26:15.532941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.532945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-15T09:26:15.532946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-15T09:26:15.532951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-15T09:26:15.532961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-15T09:26:15.532965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-15T09:26:15.532969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-15T09:26:15.532971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-15T09:26:15.532974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-15T09:26:15.532976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-15T09:26:15.532980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-15T09:26:15.532983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-15T09:26:15.532987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-15T09:26:15.532992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.532995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-15T09:26:15.532997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.533000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-15T09:26:15.533024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.533033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.533038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.533050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T09:26:15.533058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-15T09:26:15.533060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-15T09:26:15.533062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-15T09:26:15.533064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-15T09:26:15.533529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-15T09:26:15.533554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T09:26:15.533559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-15T09:26:15.533562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-15T09:26:15.533565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-15T09:26:15.533569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-15T09:26:15.533909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.534001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4506428 count 2 nextOffset 18 batches 9
2025-10-15T09:26:15.534014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.534072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,2 HeadOffset 16 endOffset 16 curOffset 18 d0000000000_00000000000000000016_00000_0000000002_00008? size 4506418 WTime 1760520375534
2025-10-15T09:26:15.534172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.534771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.534805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-15T09:26:15.534826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-15T09:26:15.534837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-15T09:26:15.534868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.534888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.534892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.535055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 9 }
2025-10-15T09:26:15.535063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 14
2025-10-15T09:26:15.535067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.535113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 7 }
2025-10-15T09:26:15.535116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 15
2025-10-15T09:26:15.535377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 24 to 24
2025-10-15T09:26:15.535431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.535450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.535513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-15T09:26:15.535575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-15T09:26:15.535626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-15T09:26:15.535638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.535650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-15T09:26:15.535678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-15T09:26:15.535704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-15T09:26:15.535712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-15T09:26:15.535826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.535833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.535841Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.535854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 4 }
2025-10-15T09:26:15.535853Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 2 size 4506418
2025-10-15T09:26:15.535865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 16
2025-10-15T09:26:15.535865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.535883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.535931Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-15T09:26:15.535933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-15T09:26:15.535947Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.535957Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505940, ReadSizeServerDelta = -3981652
2025-10-15T09:26:15.536011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.536028Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.536040Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.536153Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505940 } }
2025-10-15T09:26:15.536229Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# c8773075-ab8f2e25-4734adc8-5c050672
2025-10-15T09:26:15.536250Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# ed670788-287c8b8f-c8aac7e2-561b1fa8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.536272Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 11 ClientCommitOffset 0 committedOffset 0 Guid ed670788-287c8b8f-c8aac7e2-561b1fa8
2025-10-15T09:26:15.536382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.536391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-15T09:26:15.422000Z WriteTime: 2025-10-15T09:26:15.437000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:34640", "logtype": "unknown", "_ip": "ipv6:[::1]:34640", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.536421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 6 count 6 size 524288 endOffset 16 max time lag 0ms effective offset 6
2025-10-15T09:26:15.536444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 0 count 1 last offset 3, current partition end offset: 16
2025-10-15T09:26:15.536737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-15T09:26:15.536751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.536763Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-10-15T09:26:15.536786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-15T09:26:15.536788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.537466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.537902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.538298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 1 size 717094 from pos 1 cbcount 2
2025-10-15T09:26:15.538449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.538593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.538741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.538809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.538949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.539574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.539588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.539645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-15T09:26:15.539691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-15T09:26:15.539742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-15T09:26:15.539792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-15T09:26:15.539832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-15T09:26:15.539838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-15T09:26:15.539853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.539857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.539878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-15T09:26:15.539896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.539913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.540536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-15T09:26:15.540553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-15T09:26:15.540556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.540575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 7
2025-10-15T09:26:15.540582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 0 blobs, size 0 count 0 last offset 7, current partition end offset: 16
2025-10-15T09:26:15.540621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.540793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. All data is from uncompacted head.
2025-10-15T09:26:15.540803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-15T09:26:15.540820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 6
2025-10-15T09:26:15.541373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 25 to 25
2025-10-15T09:26:15.541660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.541672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-15T09:26:15.541717Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.542053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.542357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.544182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 26 to 26
2025-10-15T09:26:15.544393Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375462 CreateTimestampMS: 1760520375426 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375462 CreateTimestampMS: 1760520375433 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 16284546 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 6 }
2025-10-15T09:26:15.544440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.544449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-15T09:26:15.544454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.544406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.544429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.544486Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.544497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-15T09:26:15.544549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-15T09:26:15.544604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-15T09:26:15.544653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-15T09:26:15.544690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-15T09:26:15.544698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-15T09:26:15.544717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.544723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.544732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.544749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.544798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-15T09:26:15.544818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.544823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 3 size 4711504 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.544830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.544839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 1 parts 3 suffix '124' size 1741188
2025-10-15T09:26:15.544848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 3 parts 12 suffix '63' size 6759614
2025-10-15T09:26:15.544853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T09:26:15.544857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-10-15T09:26:15.544898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.545415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.545430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.545440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 8 size 6759614 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.545443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 1741188 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.545446Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.546152Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 16
2025-10-15T09:26:15.546177Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 8 ReadGuid ed670788-287c8b8f-c8aac7e2-561b1fa8 has messages 1
2025-10-15T09:26:15.546203Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 16, WTime# 1760520375462, sizeLag# 16284546
2025-10-15T09:26:15.546213Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.546228Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# ed670788-287c8b8f-c8aac7e2-561b1fa8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505820
2025-10-15T09:26:15.546235Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# ed670788-287c8b8f-c8aac7e2-561b1fa8
2025-10-15T09:26:15.546489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.546816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.546823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.546833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.546881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-15T09:26:15.546950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-15T09:26:15.547306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-15T09:26:15.547349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-15T09:26:15.547378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-15T09:26:15.547384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-15T09:26:15.547413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.547418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.547424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.547439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.547550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-15T09:26:15.547623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.548443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 2 size 4506418 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.548465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.548477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.548480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.548482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.548486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-15T09:26:15.548501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-15T09:26:15.548507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-15T09:26:15.548511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-15T09:26:15.548519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-15T09:26:15.548524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-15T09:26:15.548529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-15T09:26:15.548533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-15T09:26:15.548538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-15T09:26:15.548543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.548548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-15T09:26:15.548583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.548601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.548603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T09:26:15.548624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T09:26:15.548634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-15T09:26:15.548636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-15T09:26:15.548638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-15T09:26:15.548640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-15T09:26:15.548903Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.549000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-15T09:26:15.549016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T09:26:15.549020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-15T09:26:15.549022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-15T09:26:15.549024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-15T09:26:15.549026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-15T09:26:15.549441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.549475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-15T09:26:15.549494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T09:26:15.549497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-15T09:26:15.549500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-15T09:26:15.549502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-15T09:26:15.549504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-15T09:26:15.549727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.549960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-15T09:26:15.549975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T09:26:15.549978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-15T09:26:15.549980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-15T09:26:15.549982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-15T09:26:15.551141Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 4505820, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981532
2025-10-15T09:26:15.551218Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-15T09:26:15.551231Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 4505820 to budget
2025-10-15T09:26:15.552046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015? size 8295638
2025-10-15T09:26:15.552063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-15T09:26:15.552076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015? new key d0000000000_00000000000000000018_00000_0000000003_00015? size 8295638 WTime 1760520375551
2025-10-15T09:26:15.552191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-15T09:26:15.552206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.552298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 18 endOffset 18 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001? size 717135 WTime 1760520375551
2025-10-15T09:26:15.552424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000003_00012?
2025-10-15T09:26:15.552433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-15T09:26:15.552436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-15T09:26:15.552454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 11 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.552458Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.552488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-15T09:26:15.552514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-15T09:26:15.552593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.552612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.552794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 14 }
2025-10-15T09:26:15.552806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 17
2025-10-15T09:26:15.552812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.552877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 1 }
2025-10-15T09:26:15.552881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 18
2025-10-15T09:26:15.553150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 27 to 27
2025-10-15T09:26:15.553206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.553219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.553284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-15T09:26:15.553337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-15T09:26:15.553392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-15T09:26:15.553445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-15T09:26:15.553474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-15T09:26:15.553480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-15T09:26:15.553500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.553507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.553514Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.553525Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-15T09:26:15.553535Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-10-15T09:26:15.553545Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000003_00012?(+) to d0000000000_00000000000000000008_00000_0000000003_00012?(+)
2025-10-15T09:26:15.553547Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000002_00008?(+) to d0000000000_00000000000000000011_00000_0000000002_00008?(+)
2025-10-15T09:26:15.553549Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000001_00003|(+) to d0000000000_00000000000000000007_00001_0000000001_00003|(+)
2025-10-15T09:26:15.553557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.553564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000003_00012?
2025-10-15T09:26:15.553573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000002_00008?
2025-10-15T09:26:15.553588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.553594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.553609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.553699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.553707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.553718Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T09:26:15.553740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-15T09:26:15.553741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 12 suffix '63'
2025-10-15T09:26:15.553745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.553770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.553777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.553837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.553900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T09:26:15.554043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-15T09:26:15.554172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-15T09:26:15.554304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-15T09:26:15.554492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-15T09:26:15.554861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.554873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-15T09:26:15.554869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-15T09:26:15.554914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T09:26:15.555064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-15T09:26:15.555189Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-10-15T09:26:15.555201Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.555200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-15T09:26:15.555236Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-15T09:26:15.555248Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.555283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.555552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-15T09:26:15.426000Z WriteTime: 2025-10-15T09:26:15.462000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:34640", "logtype": "unknown", "_ip": "ipv6:[::1]:34640", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.557673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988760
2025-10-15T09:26:15.557825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-15T09:26:15.558010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-15T09:26:15.558029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988760 WTime 1760520375557
2025-10-15T09:26:15.558221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-15T09:26:15.558235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T09:26:15.558367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-15T09:26:15.558498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-15T09:26:15.558629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-15T09:26:15.558689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-15T09:26:15.558833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 28 to 28
2025-10-15T09:26:15.559072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.559083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-15T09:26:15.559093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.559128Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.559174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-15T09:26:15.559192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.559315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T09:26:15.559438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-15T09:26:15.559556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-15T09:26:15.559687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-15T09:26:15.559844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-15T09:26:15.560220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-15T09:26:15.560231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T09:26:15.560345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-15T09:26:15.560462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-15T09:26:15.560593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-15T09:26:15.560637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-15T09:26:15.561015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 7988766 count 4 nextOffset 18 batches 15
2025-10-15T09:26:15.561071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,4 HeadOffset 10 endOffset 13 curOffset 18 d0000000000_00000000000000000014_00002_0000000004_00014| size 7988756 WTime 1760520375560
2025-10-15T09:26:15.566168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.566182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.566238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-15T09:26:15.566283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-15T09:26:15.566329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-15T09:26:15.566383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-15T09:26:15.566409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-15T09:26:15.566416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-15T09:26:15.566438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.566445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.566463Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.566476Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988760
2025-10-15T09:26:15.566483Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988756
2025-10-15T09:26:15.566490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.566505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.566672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-15T09:26:15.566761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.567376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.567386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.567402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.567418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.567427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T09:26:15.567431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T09:26:15.567436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T09:26:15.567439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-15T09:26:15.567442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-15T09:26:15.567447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-15T09:26:15.567454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-15T09:26:15.567462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-15T09:26:15.567473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-15T09:26:15.567478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-15T09:26:15.567482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-15T09:26:15.567487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-15T09:26:15.567492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-15T09:26:15.567497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-15T09:26:15.567504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-15T09:26:15.567509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-15T09:26:15.567514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-15T09:26:15.567519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-15T09:26:15.567522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-15T09:26:15.567526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-15T09:26:15.567530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-15T09:26:15.567534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-15T09:26:15.567537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.567540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-15T09:26:15.567578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.567592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.567597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.567617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T09:26:15.567630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-15T09:26:15.567633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-15T09:26:15.567636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-15T09:26:15.567639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-15T09:26:15.568139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.568478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-15T09:26:15.568509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T09:26:15.568498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.568519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-15T09:26:15.568525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-15T09:26:15.568529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-15T09:26:15.568533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-15T09:26:15.568954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-15T09:26:15.568973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.569035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 22,2 HeadOffset 22 endOffset 22 curOffset 24 d0000000000_00000000000000000022_00000_0000000002_00008? size 4506418 WTime 1760520375568
2025-10-15T09:26:15.569556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.569591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.569598Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.569612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-15T09:26:15.569649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-15T09:26:15.569665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-15T09:26:15.569681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-15T09:26:15.569722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.569752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.569774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.569786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.569993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 12 }
2025-10-15T09:26:15.570007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 19
2025-10-15T09:26:15.570015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.570116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 9 }
2025-10-15T09:26:15.570125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 20
2025-10-15T09:26:15.570351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.570371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 29 to 29
2025-10-15T09:26:15.570365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.570432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-15T09:26:15.570483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-15T09:26:15.570538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-15T09:26:15.570597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-15T09:26:15.570623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-15T09:26:15.570630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-15T09:26:15.570643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.570666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-15T09:26:15.570732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.570738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.570744Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.570753Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 2 size 4506418
2025-10-15T09:26:15.570764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.570778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.570820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-15T09:26:15.570842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 5 }
2025-10-15T09:26:15.570852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 21
2025-10-15T09:26:15.570880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 2 }
2025-10-15T09:26:15.570883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 22
2025-10-15T09:26:15.570940Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (7-7)
2025-10-15T09:26:15.570955Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.570943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.570964Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505820, ReadSizeServerDelta = -3981532
2025-10-15T09:26:15.571040Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.571049Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.571127Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505820 } }
2025-10-15T09:26:15.571169Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# 8be46a2e-f53117eb-ee9c0847-24c2bd9
2025-10-15T09:26:15.571185Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# 150cd42a-4ed4d20d-219c22ee-ecc57a04, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.571200Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid 150cd42a-4ed4d20d-219c22ee-ecc57a04
2025-10-15T09:26:15.571298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.571313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.571343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 9 size 524288 endOffset 22 max time lag 0ms effective offset 8
2025-10-15T09:26:15.571366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 1 blobs, size 0 count 2 last offset 7, current partition end offset: 22
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-15T09:26:15.433000Z WriteTime: 2025-10-15T09:26:15.462000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:34640", "logtype": "unknown", "_ip": "ipv6:[::1]:34640", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.571824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-15T09:26:15.571854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295601 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.571866Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 1 blobs are from cache.
2025-10-15T09:26:15.571894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T09:26:15.571893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-15T09:26:15.572264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.572502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.572651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.572805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.572951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.573096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.573789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T09:26:15.573906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 30 to 30
2025-10-15T09:26:15.574150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.574161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-15T09:26:15.574152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.574204Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.574623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.574823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.574906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T09:26:15.575411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-15T09:26:15.576163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.576180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.576248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-15T09:26:15.576306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-15T09:26:15.576364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-15T09:26:15.576422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-15T09:26:15.576465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-15T09:26:15.576471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-15T09:26:15.576495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.576503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.576542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-15T09:26:15.576570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.576593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.577715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 31 to 31
2025-10-15T09:26:15.577999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.578010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-15T09:26:15.578050Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.578169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-15T09:26:15.578252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.578261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.578276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.578304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-10-15T09:26:15.578309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.578313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T09:26:15.578318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.578321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '124' size 7988756
2025-10-15T09:26:15.579384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.579403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000003_00015?
2025-10-15T09:26:15.579406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00003_0000000001_00001?
2025-10-15T09:26:15.579410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-15T09:26:15.579426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 13 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T09:26:15.579429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 4711504 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.579432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.579435Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.579446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.579458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000003_00015?
2025-10-15T09:26:15.579470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00003_0000000001_00001?
2025-10-15T09:26:15.579481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.579475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.579489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.579500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 21 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.579505Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T09:26:15.579525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '63'
2025-10-15T09:26:15.579526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.579529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.579534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '63'
2025-10-15T09:26:15.579704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T09:26:15.580275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 32 to 32
2025-10-15T09:26:15.580532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.580542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-15T09:26:15.580548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.580582Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.580702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988756
2025-10-15T09:26:15.580840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-15T09:26:15.580980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-15T09:26:15.581049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.581114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-15T09:26:15.581299Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 22 Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375475 CreateTimestampMS: 1760520375437 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760520375475 CreateTimestampMS: 1760520375444 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 19767046 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 22 StartOffset: 0 } Cookie: 8 }
2025-10-15T09:26:15.581325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-15T09:26:15.581345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988756 WTime 1760520375581
2025-10-15T09:26:15.581357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.581763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-15T09:26:15.581788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T09:26:15.581916Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 22
2025-10-15T09:26:15.581925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-15T09:26:15.581943Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 22 ReadOffset 10 ReadGuid 150cd42a-4ed4d20d-219c22ee-ecc57a04 has messages 1
2025-10-15T09:26:15.581973Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 22, WTime# 1760520375475, sizeLag# 19767046
2025-10-15T09:26:15.581982Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.581994Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# 150cd42a-4ed4d20d-219c22ee-ecc57a04, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505820
2025-10-15T09:26:15.582006Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# 150cd42a-4ed4d20d-219c22ee-ecc57a04
2025-10-15T09:26:15.582070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-15T09:26:15.582216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-15T09:26:15.582421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-15T09:26:15.582927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-15T09:26:15.582947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T09:26:15.583080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-15T09:26:15.583214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-15T09:26:15.583346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-15T09:26:15.583399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-15T09:26:15.583971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-15T09:26:15.584035Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.584346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T09:26:15.584359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-15T09:26:15.584361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-15T09:26:15.584368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.584481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-15T09:26:15.584826Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 4505820, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981532
2025-10-15T09:26:15.584905Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-15T09:26:15.584919Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 4505820 to budget
2025-10-15T09:26:15.587967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-10-15T09:26:15.588041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-15T09:26:15.588063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1760520375587
2025-10-15T09:26:15.588169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-15T09:26:15.588257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 14 endOffset 18 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001| size 717135 WTime 1760520375587
2025-10-15T09:26:15.589091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.589112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.589196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-15T09:26:15.589257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-15T09:26:15.589310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-15T09:26:15.589365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-15T09:26:15.589394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-15T09:26:15.589403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-15T09:26:15.589433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.589440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.589450Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.589468Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988756
2025-10-15T09:26:15.589478Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-15T09:26:15.589490Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-10-15T09:26:15.589664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.589688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.589733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-15T09:26:15.589831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.590439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 2 size 4506418 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.590473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.590480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T09:26:15.590486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.590489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.590495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-15T09:26:15.590506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-15T09:26:15.590512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-15T09:26:15.590520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-15T09:26:15.590530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-15T09:26:15.590541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-15T09:26:15.590546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-15T09:26:15.590552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-15T09:26:15.590557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-15T09:26:15.590566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.590575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-15T09:26:15.590611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.590628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.590634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T09:26:15.590654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T09:26:15.590665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-15T09:26:15.590672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-15T09:26:15.590675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-15T09:26:15.590678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-15T09:26:15.591080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 2253230 count 1 nextOffset 25 batches 5
2025-10-15T09:26:15.591111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T09:26:15.591118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-15T09:26:15.591125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-15T09:26:15.591128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-15T09:26:15.591131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-15T09:26:15.591122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.591369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.591648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 4506428 count 2 nextOffset 26 batches 9
2025-10-15T09:26:15.591673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T09:26:15.591679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-15T09:26:15.591682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-15T09:26:15.591685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-15T09:26:15.591688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-15T09:26:15.592251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 24 PartNo 0 PackedSize 6759626 count 3 nextOffset 27 batches 13
2025-10-15T09:26:15.592271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.592350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 24,3 HeadOffset 24 endOffset 24 curOffset 27 d0000000000_00000000000000000024_00000_0000000003_00012? size 6759616 WTime 1760520375591
2025-10-15T09:26:15.596566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.596599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.596607Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.596646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-15T09:26:15.596675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-15T09:26:15.596738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.596758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.597009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 13 }
2025-10-15T09:26:15.597023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 23
2025-10-15T09:26:15.597028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.597115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 2 }
2025-10-15T09:26:15.597124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 24
2025-10-15T09:26:15.597365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 33 to 33
2025-10-15T09:26:15.597488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.597508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.597580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-15T09:26:15.597606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.597616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-15T09:26:15.597656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-15T09:26:15.597716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-15T09:26:15.597769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-15T09:26:15.597808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-15T09:26:15.597816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-15T09:26:15.597916Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-10-15T09:26:15.597930Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.597965Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-15T09:26:15.597976Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.597940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.597950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.597968Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.597982Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 24 partNo 0 count 3 size 6759616
2025-10-15T09:26:15.597989Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000003_00012?(+) to d0000000000_00000000000000000013_00000_0000000003_00012?(+)
2025-10-15T09:26:15.597991Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000002_00008?(+) to d0000000000_00000000000000000016_00000_0000000002_00008?(+)
2025-10-15T09:26:15.597994Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000003_00008|(+) to d0000000000_00000000000000000010_00004_0000000003_00008|(+)
2025-10-15T09:26:15.598001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.598020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.598078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-15T09:26:15.598131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-15T09:26:15.437000Z WriteTime: 2025-10-15T09:26:15.475000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:34640", "logtype": "unknown", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.599529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.599844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.600263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.600284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.600395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-15T09:26:15.600442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-15T09:26:15.600506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-15T09:26:15.600564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-15T09:26:15.600610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-15T09:26:15.600621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-15T09:26:15.600657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.600667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.600676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.600701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.600840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-15T09:26:15.600903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.601402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 34 to 34
2025-10-15T09:26:15.601682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.601690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-15T09:26:15.601694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.601724Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.602040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.602332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.602586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.602606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.602671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-15T09:26:15.602732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-15T09:26:15.602792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-15T09:26:15.602850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-15T09:26:15.602890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-15T09:26:15.602899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-15T09:26:15.602970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.602982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.602989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.603005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.603023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.603031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.603036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.603055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.603086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T09:26:15.603102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T09:26:15.603108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '124' size 7988756
2025-10-15T09:26:15.603111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-15T09:26:15.603114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-15T09:26:15.603290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.603304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.603314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-15T09:26:15.603346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T09:26:15.603354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.603357Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.603373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.603946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 24 count 3 size 6759616 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.603965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.603970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T09:26:15.603980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.603982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.603987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.603997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-15T09:26:15.604006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-15T09:26:15.604012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-15T09:26:15.604019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-15T09:26:15.604034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-15T09:26:15.604045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-15T09:26:15.604050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-15T09:26:15.604056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-15T09:26:15.604069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-15T09:26:15.604075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-15T09:26:15.604081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-15T09:26:15.604086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-15T09:26:15.604092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-15T09:26:15.604102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-15T09:26:15.604108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.604112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-15T09:26:15.604144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.604163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.604171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T09:26:15.604195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T09:26:15.604210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-15T09:26:15.604218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-15T09:26:15.604221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-15T09:26:15.604224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-15T09:26:15.604437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.604611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-15T09:26:15.604639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T09:26:15.604650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-15T09:26:15.604654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-15T09:26:15.604663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-15T09:26:15.604654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.604667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-15T09:26:15.605424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-10-15T09:26:15.605451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T09:26:15.605465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-15T09:26:15.605468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-15T09:26:15.605472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-15T09:26:15.605481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-15T09:26:15.605976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 6759626 count 3 nextOffset 30 batches 13
2025-10-15T09:26:15.605997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.606091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 27,3 HeadOffset 27 endOffset 27 curOffset 30 d0000000000_00000000000000000027_00000_0000000003_00012? size 6759616 WTime 1760520375605
2025-10-15T09:26:15.606854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000002_00008?
2025-10-15T09:26:15.606871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000024_00000_0000000003_00012?
2025-10-15T09:26:15.606874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-15T09:26:15.606891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.606895Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.606920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-15T09:26:15.606950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-15T09:26:15.606970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-15T09:26:15.607011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.607028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.607032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.607218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 19 }
2025-10-15T09:26:15.607227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 25
2025-10-15T09:26:15.607231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.607284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 14 }
2025-10-15T09:26:15.607287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 26
2025-10-15T09:26:15.607491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 35 to 35
2025-10-15T09:26:15.607688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.607702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.607742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.607750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-15T09:26:15.607769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-15T09:26:15.607828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-15T09:26:15.607887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-15T09:26:15.607946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-15T09:26:15.607955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 2 }
2025-10-15T09:26:15.607964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 27
2025-10-15T09:26:15.607982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-15T09:26:15.607990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-15T09:26:15.608011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.608018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.608025Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.608040Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 3 size 6759616
2025-10-15T09:26:15.608047Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000003_00015?(+) to d0000000000_00000000000000000018_00000_0000000003_00015?(+)
2025-10-15T09:26:15.608050Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001?(+) to d0000000000_00000000000000000021_00003_0000000001_00001?(+)
2025-10-15T09:26:15.608052Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000004_00014|(+) to d0000000000_00000000000000000014_00002_0000000004_00014|(+)
2025-10-15T09:26:15.608054Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (9-9)
2025-10-15T09:26:15.608066Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T09:26:15.608061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.608072Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505820, ReadSizeServerDelta = -3981532
2025-10-15T09:26:15.608068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000002_00008?
2025-10-15T09:26:15.608077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000024_00000_0000000003_00012?
2025-10-15T09:26:15.608093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.608119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.608137Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.608144Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.608137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.608192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 22 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.608199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 24 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.608208Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T09:26:15.608226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.608234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-15T09:26:15.608234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 3 parts 12 suffix '63'
2025-10-15T09:26:15.608234Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505820 } }
2025-10-15T09:26:15.608257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.608264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.608278Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# b2038d19-8ee39e74-abc9ec8e-59509fa7
2025-10-15T09:26:15.608295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.608298Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# 767aa6d0-a5c8a878-3b1d62c1-7301889b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 14, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.608314Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 14 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 22 ClientCommitOffset 0 committedOffset 0 Guid 767aa6d0-a5c8a878-3b1d62c1-7301889b
2025-10-15T09:26:15.608390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T09:26:15.608531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-15T09:26:15.608665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
>>> Got event: 2025-10-15T09:26:15.608803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-15T09:26:15.444000Z WriteTime: 2025-10-15T09:26:15.475000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:34640", "logtype": "unknown", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.609012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-15T09:26:15.609411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-15T09:26:15.609434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T09:26:15.609565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-15T09:26:15.609607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.609727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-15T09:26:15.609865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.609876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-15T09:26:15.609953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-15T09:26:15.610452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-15T09:26:15.610472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.610609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T09:26:15.610758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-15T09:26:15.610902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-15T09:26:15.611027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 36 to 36
2025-10-15T09:26:15.611046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-15T09:26:15.611266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.611276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-15T09:26:15.611236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-15T09:26:15.611311Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.611720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-15T09:26:15.611741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T09:26:15.611865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-15T09:26:15.613053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988782
2025-10-15T09:26:15.613195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-15T09:26:15.613244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 37 to 37
2025-10-15T09:26:15.613344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-15T09:26:15.613487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.613496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-15T09:26:15.613501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.613526Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.613534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-15T09:26:15.613556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988782 WTime 1760520375613
2025-10-15T09:26:15.613861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-15T09:26:15.613882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T09:26:15.614013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-15T09:26:15.614153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-15T09:26:15.614291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-15T09:26:15.614345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-15T09:26:15.614828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-15T09:26:15.614926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 21 endOffset 22 curOffset 27 d0000000000_00000000000000000025_00001_0000000002_00007| size 3994387 WTime 1760520375614
2025-10-15T09:26:15.615418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.615432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.616190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.616206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.616273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-15T09:26:15.616329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-15T09:26:15.616391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-15T09:26:15.616452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-15T09:26:15.616480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-15T09:26:15.616488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-15T09:26:15.616508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.616515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.616539Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.616555Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988782
2025-10-15T09:26:15.616566Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 2 size 3994387
2025-10-15T09:26:15.616586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.616607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.616828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-15T09:26:15.616860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 14 size 524288 endOffset 27 max time lag 0ms effective offset 10
2025-10-15T09:26:15.616892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 2 blobs, size 7988760 count 4 last offset 10, current partition end offset: 27
2025-10-15T09:26:15.616901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-15T09:26:15.616910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.616912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.616918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 13. Have to read 2 of 2 from KV
2025-10-15T09:26:15.616902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.616936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-10-15T09:26:15.616943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T09:26:15.617436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 21 count 1 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.617449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 3 size 6759616 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.617462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.617475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T09:26:15.617478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.617483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T09:26:15.617483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.617490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-15T09:26:15.617493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-15T09:26:15.617499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-15T09:26:15.617505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-15T09:26:15.617515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-15T09:26:15.617521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-15T09:26:15.617532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-15T09:26:15.617537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-15T09:26:15.617541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-15T09:26:15.617547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-15T09:26:15.617552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-15T09:26:15.617557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-15T09:26:15.617561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-15T09:26:15.617566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-15T09:26:15.617571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.617575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-15T09:26:15.617609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.617641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.617647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.617665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T09:26:15.617677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-15T09:26:15.617684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-15T09:26:15.617687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-15T09:26:15.617690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-15T09:26:15.618094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 2253230 count 1 nextOffset 31 batches 5
2025-10-15T09:26:15.618124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T09:26:15.618130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-15T09:26:15.618133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-15T09:26:15.618137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-15T09:26:15.618140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-15T09:26:15.618292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.618622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 4506428 count 2 nextOffset 32 batches 9
2025-10-15T09:26:15.618643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.618725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,2 HeadOffset 30 endOffset 30 curOffset 32 d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418 WTime 1760520375618
2025-10-15T09:26:15.618826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.620680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.620718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.620723Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.620739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-15T09:26:15.620764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-15T09:26:15.620779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-15T09:26:15.620829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.620850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.620854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.621045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 6 }
2025-10-15T09:26:15.621056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 28
2025-10-15T09:26:15.621060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.621148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 3 }
2025-10-15T09:26:15.621159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 29
2025-10-15T09:26:15.621358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 38 to 38
2025-10-15T09:26:15.621522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.621538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.621602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-15T09:26:15.621665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.621677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-15T09:26:15.621679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-15T09:26:15.621721Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.621733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-15T09:26:15.621782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-15T09:26:15.621808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-15T09:26:15.621814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-15T09:26:15.621832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.621837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.621864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 2 }
2025-10-15T09:26:15.621869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 30
2025-10-15T09:26:15.621915Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.621931Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 2 size 4506418
2025-10-15T09:26:15.621938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.621950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.622096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.621993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-15T09:26:15.623923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.623935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.623992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-15T09:26:15.624039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-15T09:26:15.624082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-15T09:26:15.624164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-15T09:26:15.624198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-15T09:26:15.624204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-15T09:26:15.624239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.624252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.624521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.624875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.625004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.625012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.625024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-15T09:26:15.625035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 39 to 39
2025-10-15T09:26:15.625082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.625262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.625271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-15T09:26:15.625300Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.626234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.626522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.626935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.626950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.627009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-15T09:26:15.627071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-15T09:26:15.627131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-15T09:26:15.627190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-15T09:26:15.627232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-15T09:26:15.627240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-15T09:26:15.627261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.627270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.627276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.627290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.627304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-15T09:26:15.627375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.627862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 40 to 40
2025-10-15T09:26:15.628094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.628104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-15T09:26:15.628109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.628143Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.628444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.628692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.629135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.629153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.629217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-15T09:26:15.629280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-15T09:26:15.629334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-15T09:26:15.629384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-15T09:26:15.629424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-15T09:26:15.629431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-15T09:26:15.629455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.629462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.629469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.629485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.629499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-15T09:26:15.629587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.630850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.631114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.631704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.631724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.631785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-15T09:26:15.631840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-15T09:26:15.631899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-15T09:26:15.631962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-15T09:26:15.632016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-15T09:26:15.632027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-15T09:26:15.632053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.632059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.632066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.632079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.632090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-15T09:26:15.632184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.632344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.633575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.633857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.634281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.634297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.634357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-15T09:26:15.634416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-15T09:26:15.634467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-15T09:26:15.634516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-15T09:26:15.634555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-15T09:26:15.634563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-15T09:26:15.634585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.634591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.634597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.634610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.634622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-15T09:26:15.634708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.636123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.636400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.636636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.636648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.636692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-15T09:26:15.636744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-15T09:26:15.636802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-15T09:26:15.636852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-15T09:26:15.636898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-15T09:26:15.636911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-15T09:26:15.636931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.636935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.636941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.636953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.636965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-15T09:26:15.637047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.639229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.639240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.639284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-15T09:26:15.639327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-15T09:26:15.639375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-15T09:26:15.639427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-15T09:26:15.639469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-15T09:26:15.639476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-15T09:26:15.639511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.639524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.642350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T09:26:15.642362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T09:26:15.642363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T09:26:15.642370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.642372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.642411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-15T09:26:15.642421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T09:26:15.642425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-15T09:26:15.642428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.642430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T09:26:15.642485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-15T09:26:15.644396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-15T09:26:15.644608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T09:26:15.644732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.644847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.645241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.645818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T09:26:15.646129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.646246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.646373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.646450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-15T09:26:15.646563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T09:26:15.646696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.646823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.647033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.647242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-15T09:26:15.648581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-15T09:26:15.648634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.648644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 717135 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.648647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 4
2025-10-15T09:26:15.648652Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.648763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-15T09:26:15.648796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988782 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.648805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 3994387 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.648844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 24 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.648854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-15T09:26:15.648857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.648859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-15T09:26:15.651432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.652020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.652038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.652053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 24 size 6759616 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.652056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 6759616 cause it's been evicted from L2. Actual L1 size: 4
2025-10-15T09:26:15.652060Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.652129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.652152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.652175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.652178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.652185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-15T09:26:15.652204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-15T09:26:15.652211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-15T09:26:15.652216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-15T09:26:15.652227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-15T09:26:15.652238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-15T09:26:15.652244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-15T09:26:15.652250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-15T09:26:15.652257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-15T09:26:15.652263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.652267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-15T09:26:15.652296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.652330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.652337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (40)
2025-10-15T09:26:15.652363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T09:26:15.652377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-15T09:26:15.652385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-15T09:26:15.652389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-15T09:26:15.652394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-15T09:26:15.652786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2253230 count 1 nextOffset 33 batches 5
2025-10-15T09:26:15.652814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T09:26:15.652826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-15T09:26:15.652830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-15T09:26:15.652833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-15T09:26:15.652837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-15T09:26:15.653460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 4506428 count 2 nextOffset 34 batches 9
2025-10-15T09:26:15.653482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T09:26:15.653486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-15T09:26:15.653488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-15T09:26:15.653491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-15T09:26:15.653493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-15T09:26:15.654211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 6759626 count 3 nextOffset 35 batches 13
2025-10-15T09:26:15.654236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T09:26:15.654242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-15T09:26:15.654246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-15T09:26:15.654250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-15T09:26:15.655491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 36 partNo 3 result is x0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
2025-10-15T09:26:15.655510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-15T09:26:15.655525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00000_0000000003_00015? new key d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638 WTime 1760520375655
2025-10-15T09:26:15.655652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 1 NewHead: Offset 35 PartNo 3 PackedSize 717145 count 1 nextOffset 36 batches 2
2025-10-15T09:26:15.655670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-15T09:26:15.655676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-15T09:26:15.655681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-15T09:26:15.655684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-15T09:26:15.655688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-15T09:26:15.656181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 3 PackedSize 2970343 count 2 nextOffset 37 batches 6
2025-10-15T09:26:15.656203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T09:26:15.656209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-15T09:26:15.656217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-15T09:26:15.656221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-15T09:26:15.656223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-15T09:26:15.656898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 3 PackedSize 5223541 count 3 nextOffset 38 batches 10
2025-10-15T09:26:15.656919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T09:26:15.656924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-15T09:26:15.656928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-15T09:26:15.656937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-15T09:26:15.656940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-15T09:26:15.657397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 3 PackedSize 7476739 count 4 nextOffset 39 batches 14
2025-10-15T09:26:15.657421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T09:26:15.657431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T09:26:15.658060Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 30 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375476 CreateTimestampMS: 1760520375451 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375498 CreateTimestampMS: 1760520375458 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375499 CreateTimestampMS: 1760520375463 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375511 CreateTimestampMS: 1760520375469 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 5735998 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 30 StartOffset: 0 } Cookie: 10 }
2025-10-15T09:26:15.658603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 40 partNo 1 result is x0000000000_00000000000000000035_00003_0000000004_00014? size 7988760
2025-10-15T09:26:15.658620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-15T09:26:15.658625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-15T09:26:15.658629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-15T09:26:15.658643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000035_00003_0000000004_00014? new key d0000000000_00000000000000000035_00003_0000000004_00014? size 7988760 WTime 1760520375658
2025-10-15T09:26:15.658973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 1 NewHead: Offset 39 PartNo 1 PackedSize 1741199 count 1 nextOffset 40 batches 4
2025-10-15T09:26:15.658992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.659103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,1 HeadOffset 32 endOffset 32 curOffset 40 d0000000000_00000000000000000039_00001_0000000001_00003? size 1741189 WTime 1760520375658
2025-10-15T09:26:15.659145Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 30
2025-10-15T09:26:15.659177Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 30 ReadOffset 14 ReadGuid 767aa6d0-a5c8a878-3b1d62c1-7301889b has messages 1
2025-10-15T09:26:15.659202Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 30, WTime# 1760520375511, sizeLag# 5735998
2025-10-15T09:26:15.659215Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.659235Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# 767aa6d0-a5c8a878-3b1d62c1-7301889b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011868
2025-10-15T09:26:15.659247Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# 767aa6d0-a5c8a878-3b1d62c1-7301889b
2025-10-15T09:26:15.659328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-15T09:26:15.659341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-15T09:26:15.659345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-15T09:26:15.659400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-15T09:26:15.659433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-15T09:26:15.659446Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.659462Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 3 size 8295638
2025-10-15T09:26:15.659473Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 3 count 4 size 7988760
2025-10-15T09:26:15.659483Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 1 count 1 size 1741189
2025-10-15T09:26:15.659493Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000002_00008?(+) to d0000000000_00000000000000000022_00000_0000000002_00008?(+)
2025-10-15T09:26:15.659495Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000024_00000_0000000003_00012?(+) to d0000000000_00000000000000000024_00000_0000000003_00012?(+)
2025-10-15T09:26:15.659497Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001|(+) to d0000000000_00000000000000000021_00003_0000000001_00001|(+)
2025-10-15T09:26:15.659504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.659511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-15T09:26:15.659521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-15T09:26:15.659536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.659546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.659580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.659612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 27 partno 0 count 3 parts_count 12 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.659622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.659632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-15T09:26:15.659654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.659666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 27 partno 0 count 3 parts_count 12
2025-10-15T09:26:15.659927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 34 queued_in_partition_duration_ms: 9 }
2025-10-15T09:26:15.659947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 31
2025-10-15T09:26:15.659954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.660081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 1 }
2025-10-15T09:26:15.660090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 32
2025-10-15T09:26:15.660366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 41 to 41
2025-10-15T09:26:15.660601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.660611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-15T09:26:15.660977Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.661845Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.663527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 42 to 42
2025-10-15T09:26:15.663824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.663834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-15T09:26:15.664124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.664156Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.664763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.665041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.665235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.665252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.665283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-15T09:26:15.665375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.666250Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 9011868, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487580
2025-10-15T09:26:15.666347Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-15T09:26:15.666363Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 9011868 to budget
2025-10-15T09:26:15.666739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.667006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.667830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.667848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.667918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-15T09:26:15.667980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-15T09:26:15.668040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-15T09:26:15.668095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-15T09:26:15.668145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-15T09:26:15.668154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-15T09:26:15.668177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.668186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.668195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.668220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.668238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-15T09:26:15.668339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.670780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.670793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.670853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-15T09:26:15.670905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-15T09:26:15.670956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-15T09:26:15.671008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-15T09:26:15.671047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-15T09:26:15.671054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-15T09:26:15.671091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.671113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.671983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-15T09:26:15.672000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T09:26:15.672011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 27 count 3 size 6759616 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.672051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.672053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T09:26:15.672058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.672062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.672211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T09:26:15.672353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-15T09:26:15.672490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-15T09:26:15.672627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-15T09:26:15.672884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-15T09:26:15.673271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-15T09:26:15.673288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T09:26:15.673413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-15T09:26:15.673547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-15T09:26:15.673702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-15T09:26:15.673897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-15T09:26:15.675327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295604
2025-10-15T09:26:15.675349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295604 WTime 1760520375675
2025-10-15T09:26:15.675369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-15T09:26:15.675376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T09:26:15.675511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-15T09:26:15.675674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-15T09:26:15.675814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-15T09:26:15.675888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-15T09:26:15.676383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-15T09:26:15.676402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.676527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T09:26:15.676675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-15T09:26:15.676821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-15T09:26:15.676941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-15T09:26:15.677109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-15T09:26:15.677539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-10-15T09:26:15.677554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T09:26:15.677692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-15T09:26:15.677839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-15T09:26:15.677984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-15T09:26:15.678053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-15T09:26:15.678489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
2025-10-15T09:26:15.678555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,4 HeadOffset 25 endOffset 27 curOffset 32 d0000000000_00000000000000000028_00004_0000000004_00012| size 6964702 WTime 1760520375678
2025-10-15T09:26:15.679305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.679316Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.679339Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.679350Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295604
2025-10-15T09:26:15.679353Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 6964702
2025-10-15T09:26:15.680310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.680319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 4 size 7988760 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.680323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 39 count 1 size 1741189 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.680342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.680345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T09:26:15.680348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T09:26:15.680351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-15T09:26:15.680353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-15T09:26:15.680356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T09:26:15.680363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18023288 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.680369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-15T09:26:15.680387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-15T09:26:15.680393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-15T09:26:15.680399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-15T09:26:15.680408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-15T09:26:15.680416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-15T09:26:15.680427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-15T09:26:15.680432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-15T09:26:15.680437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-15T09:26:15.680447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-15T09:26:15.680452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-15T09:26:15.680464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-15T09:26:15.680469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-15T09:26:15.680478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-15T09:26:15.680488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-15T09:26:15.680498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-15T09:26:15.680503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-15T09:26:15.680512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-15T09:26:15.680517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-15T09:26:15.680525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-15T09:26:15.680529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-15T09:26:15.680537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-15T09:26:15.680542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-15T09:26:15.680550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-15T09:26:15.680559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-15T09:26:15.680564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-15T09:26:15.680567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-15T09:26:15.680571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-15T09:26:15.680576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-15T09:26:15.680581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-15T09:26:15.680586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-15T09:26:15.680590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-10-15T09:26:15.680607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-10-15T09:26:15.680622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-10-15T09:26:15.680627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-10-15T09:26:15.680631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-15T09:26:15.680640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-10-15T09:26:15.680646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-10-15T09:26:15.680655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-10-15T09:26:15.680664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.680668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-10-15T09:26:15.680711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.680729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.680735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T09:26:15.680753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-15T09:26:15.680766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-15T09:26:15.680773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-15T09:26:15.680775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-15T09:26:15.680782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-15T09:26:15.681193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-15T09:26:15.681218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-15T09:26:15.681228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-15T09:26:15.681235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-15T09:26:15.681238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-15T09:26:15.681241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-15T09:26:15.681862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-15T09:26:15.681884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.681992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 40,2 HeadOffset 40 endOffset 40 curOffset 42 d0000000000_00000000000000000040_00000_0000000002_00008? size 4506418 WTime 1760520375681
2025-10-15T09:26:15.682487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.682518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988782 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T09:26:15.682524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.682528Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.682567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-15T09:26:15.682595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-15T09:26:15.682611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-15T09:26:15.682626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-15T09:26:15.682641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-15T09:26:15.682654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-15T09:26:15.682671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-15T09:26:15.682686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-15T09:26:15.682693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.682780Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.682795Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 2 size 4506418
2025-10-15T09:26:15.683114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 30 }
2025-10-15T09:26:15.683126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 33
2025-10-15T09:26:15.683130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T09:26:15.683250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 28 }
2025-10-15T09:26:15.683260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 34
2025-10-15T09:26:15.683571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 43 to 43
2025-10-15T09:26:15.683846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.683858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-15T09:26:15.685225Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-15T09:26:15.685245Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T09:26:15.685288Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-15T09:26:15.685300Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.685589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.685716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 26 }
2025-10-15T09:26:15.685722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 35
2025-10-15T09:26:15.685775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 24 }
2025-10-15T09:26:15.685778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 36
2025-10-15T09:26:15.685799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 23 }
2025-10-15T09:26:15.685802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 37
2025-10-15T09:26:15.685823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 21 }
2025-10-15T09:26:15.685825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 38
2025-10-15T09:26:15.685846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 19 }
2025-10-15T09:26:15.685850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 39
2025-10-15T09:26:15.685871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 17 }
2025-10-15T09:26:15.685872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 40
2025-10-15T09:26:15.685914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: 2025-10-15T09:26:15.686076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.686089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.686112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-15T09:26:15.451000Z WriteTime: 2025-10-15T09:26:15.476000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:34640", "logtype": "unknown", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.686191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.688496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.688514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.688589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-15T09:26:15.688647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-15T09:26:15.688704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-15T09:26:15.688766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-15T09:26:15.688805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-15T09:26:15.688814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-15T09:26:15.688889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.688915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.688933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295604 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.688941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 6964702 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.688945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 44 to 44
2025-10-15T09:26:15.688956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.688988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-15T09:26:15.689001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.689009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-15T09:26:15.689017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T09:26:15.689024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-15T09:26:15.689260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.689272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-15T09:26:15.689999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.690014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-15T09:26:15.690017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000004_00014?
2025-10-15T09:26:15.690020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 16284398 bytes
2025-10-15T09:26:15.690036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T09:26:15.690039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 3994387 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.690041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 6759616 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.690045Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.690074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T09:26:15.690081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-15T09:26:15.690093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000004_00014?
2025-10-15T09:26:15.690108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T09:26:15.690249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.690259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 3 count 4 parts_count 14 source 1 size 7988760 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.690264Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T09:26:15.690276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63'
2025-10-15T09:26:15.690286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 4 parts 14 suffix '63'
2025-10-15T09:26:15.690295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.690303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.690437Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T09:26:15.690441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.690596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-15T09:26:15.690749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-15T09:26:15.691051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.691339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.691940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988738
2025-10-15T09:26:15.692070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-15T09:26:15.692288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-15T09:26:15.692308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988738 WTime 1760520375692
2025-10-15T09:26:15.692490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-10-15T09:26:15.692503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T09:26:15.692628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-15T09:26:15.692753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-15T09:26:15.692875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-15T09:26:15.693067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-15T09:26:15.693319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 45 to 45
2025-10-15T09:26:15.693572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 3482370 count 2 nextOffset 34 batches 7
2025-10-15T09:26:15.693589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T09:26:15.693620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.693649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-15T09:26:15.693744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-15T09:26:15.693877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-15T09:26:15.694016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-15T09:26:15.694088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-15T09:26:15.694542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 5735568 count 3 nextOffset 35 batches 11
2025-10-15T09:26:15.694914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T09:26:15.694925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-15T09:26:15.694926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-15T09:26:15.694933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.695048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-15T09:26:15.695264Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (11-11)
2025-10-15T09:26:15.695250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-15T09:26:15.695283Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T09:26:15.695330Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-15T09:26:15.695344Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.695670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 7988766 count 4 nextOffset 36 batches 15
2025-10-15T09:26:15.695683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-15T09:26:15.458000Z WriteTime: 2025-10-15T09:26:15.498000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:34640", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.696904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 37 partNo 0 result is x0000000000_00000000000000000032_00002_0000000004_00014 size 7988756
2025-10-15T09:26:15.697021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-15T09:26:15.697145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-15T09:26:15.697264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-15T09:26:15.697447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-15T09:26:15.697464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00002_0000000004_00014 new key d0000000000_00000000000000000032_00002_0000000004_00014 size 7988756 WTime 1760520375697
2025-10-15T09:26:15.697816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 37 partNo 4 FormedBlobsCount 1 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-15T09:26:15.697830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T09:26:15.697953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-15T09:26:15.698074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-15T09:26:15.698195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-15T09:26:15.698385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-15T09:26:15.698782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-15T09:26:15.698797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T09:26:15.698928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-15T09:26:15.699060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-15T09:26:15.699187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-15T09:26:15.699261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-15T09:26:15.699664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 6759626 count 3 nextOffset 39 batches 13
2025-10-15T09:26:15.699790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T09:26:15.699849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 46 to 46
2025-10-15T09:26:15.699873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,3 HeadOffset 28 endOffset 32 curOffset 39 d0000000000_00000000000000000036_00000_0000000003_00012| size 6759616 WTime 1760520375699
2025-10-15T09:26:15.700108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.700121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-15T09:26:15.701094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.701107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.701121Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.701129Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988738
2025-10-15T09:26:15.701133Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 4 size 7988756
2025-10-15T09:26:15.701137Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 6759616
2025-10-15T09:26:15.701150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 40 count 2 size 4506418 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.701205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.701213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T09:26:15.701220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-15T09:26:15.701224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.701226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.701231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-15T09:26:15.701245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 1, Offset: 40 is stored on disk
2025-10-15T09:26:15.701250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 2, Offset: 40 is stored on disk
2025-10-15T09:26:15.701253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 3, Offset: 40 is stored on disk
2025-10-15T09:26:15.701259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 4, Offset: 40 is stored on disk
2025-10-15T09:26:15.701264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-15T09:26:15.701268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 1, Offset: 41 is stored on disk
2025-10-15T09:26:15.701271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 2, Offset: 41 is stored on disk
2025-10-15T09:26:15.701274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 3, Offset: 41 is stored on disk
2025-10-15T09:26:15.701277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.701279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 4, Offset: 41 is stored on disk
2025-10-15T09:26:15.701294Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-15T09:26:15.701305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.701317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.701320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T09:26:15.701334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-15T09:26:15.701342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-15T09:26:15.701344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-15T09:26:15.701347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-15T09:26:15.701348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-15T09:26:15.701715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 42 PartNo 0 PackedSize 2253230 count 1 nextOffset 43 batches 5
2025-10-15T09:26:15.701732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.701817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 42,1 HeadOffset 42 endOffset 42 curOffset 43 d0000000000_00000000000000000042_00000_0000000001_00004? size 2253220 WTime 1760520375701
2025-10-15T09:26:15.702146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T09:26:15.702173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-15T09:26:15.702217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295604 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.702223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 39 size 1741189 cause it's been evicted from L2. Actual L1 size: 4
2025-10-15T09:26:15.702226Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.702246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-15T09:26:15.702263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-10-15T09:26:15.702281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.702348Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.702363Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 42 partNo 0 count 1 size 2253220
2025-10-15T09:26:15.702368Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00012?(+) to d0000000000_00000000000000000027_00000_0000000003_00012?(+)
2025-10-15T09:26:15.702370Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00000_0000000002_00008?(+) to d0000000000_00000000000000000030_00000_0000000002_00008?(+)
2025-10-15T09:26:15.702372Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-10-15T09:26:15.703227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.703330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.703603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 20 queued_in_partition_duration_ms: 12 }
2025-10-15T09:26:15.703619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 41
2025-10-15T09:26:15.703674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 10 }
2025-10-15T09:26:15.703677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 42
2025-10-15T09:26:15.703830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.704091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.704323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 47 to 47
2025-10-15T09:26:15.704509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.704526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.704608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.704598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-15T09:26:15.704617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-15T09:26:15.704654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-15T09:26:15.704708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-15T09:26:15.704764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-15T09:26:15.704799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-15T09:26:15.704808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-15T09:26:15.704832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.704841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.704847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.704862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.704873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-10-15T09:26:15.704937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.706080Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (12-12)
2025-10-15T09:26:15.706098Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T09:26:15.706139Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-10-15T09:26:15.706151Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.706358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.706583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-15T09:26:15.463000Z WriteTime: 2025-10-15T09:26:15.499000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:34640", "server": "ipv6:[::1]:34640" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.707142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.707162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.707234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-15T09:26:15.707297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-15T09:26:15.707358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-15T09:26:15.707418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-15T09:26:15.707465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-15T09:26:15.707474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-15T09:26:15.707496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.707502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.707511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.707528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.707544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-15T09:26:15.707630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.708926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.709152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.709691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.709701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.709773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-15T09:26:15.709821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-15T09:26:15.709871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-15T09:26:15.709932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-15T09:26:15.709979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-15T09:26:15.709986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-15T09:26:15.710003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.710005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.710011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.710030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.710042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-15T09:26:15.710075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 48 to 48
2025-10-15T09:26:15.710122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.710342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.710352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-15T09:26:15.711525Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.711911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.712157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.712176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.712193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.712251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-15T09:26:15.712325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-15T09:26:15.712405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-15T09:26:15.712465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-15T09:26:15.712501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-15T09:26:15.712509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-15T09:26:15.712532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.712538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.712544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.712555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.712566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-15T09:26:15.712628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.714526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.714545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.714614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-15T09:26:15.714669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-15T09:26:15.714722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-15T09:26:15.714776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-15T09:26:15.714817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-15T09:26:15.714825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-15T09:26:15.714842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.714862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.715420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 49 to 49
2025-10-15T09:26:15.715715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.715728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-15T09:26:15.716762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988738 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.716773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 4 size 7988756 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.716775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.716791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.716808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-15T09:26:15.716813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T09:26:15.716817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T09:26:15.716819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T09:26:15.716822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-15T09:26:15.716824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T09:26:15.717690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.717702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T09:26:15.717714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.717716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 6964702 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.717718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 35 size 7988760 cause it's been evicted from L2. Actual L1 size: 4
2025-10-15T09:26:15.717724Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.717947Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (13-13)
2025-10-15T09:26:15.717966Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-15T09:26:15.717976Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] In ContinueReadingDataImpl, ReadSizeBudget = 9011868, ReadSizeServerDelta = -8487580
2025-10-15T09:26:15.718056Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T09:26:15.718065Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 0 to budget
2025-10-15T09:26:15.718105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.718177Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 grpc read done: success# 1, data# { read_request { bytes_size: 9011868 } }
2025-10-15T09:26:15.718250Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 got read request: guid# 505827b3-105b17b4-53bd4f47-cc12d302
2025-10-15T09:26:15.718272Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 performing read request: guid# 59cf3d09-e1347c1d-c68c7d8e-84cb78c3, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T09:26:15.718294Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 14 EndOffset 30 ClientCommitOffset 0 committedOffset 0 Guid 59cf3d09-e1347c1d-c68c7d8e-84cb78c3
2025-10-15T09:26:15.718383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.718422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.718432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.718463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 42 count 1 size 2253220 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.718479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 42 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T09:26:15.718482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.718483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.718487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T09:26:15.718501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T09:26:15.718504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.718510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-15T09:26:15.718513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.718515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 1, Offset: 42 is stored on disk
2025-10-15T09:26:15.718518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.718521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 2, Offset: 42 is stored on disk
2025-10-15T09:26:15.718522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.718524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 3, Offset: 42 is stored on disk
2025-10-15T09:26:15.718527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T09:26:15.718530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 4, Offset: 42 is stored on disk
2025-10-15T09:26:15.718549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.718565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.718568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-15T09:26:15.718587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-15T09:26:15.718600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-15T09:26:15.718604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-15T09:26:15.718607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-15T09:26:15.718610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-15T09:26:15.469000Z WriteTime: 2025-10-15T09:26:15.511000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:34640", "logtype": "unknown", "server": "ipv6:[::1]:34640", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T09:26:15.718961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 0 PackedSize 2253230 count 1 nextOffset 44 batches 5
2025-10-15T09:26:15.718980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-15T09:26:15.718984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-15T09:26:15.718986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-15T09:26:15.718988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-15T09:26:15.718992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-15T09:26:15.719414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 0 PackedSize 4506428 count 2 nextOffset 45 batches 9
2025-10-15T09:26:15.719429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-15T09:26:15.719434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-15T09:26:15.719436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-15T09:26:15.719438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-15T09:26:15.719442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-15T09:26:15.719863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 0 PackedSize 6759626 count 3 nextOffset 46 batches 13
2025-10-15T09:26:15.719884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-15T09:26:15.719889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-15T09:26:15.719896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-15T09:26:15.719898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-15T09:26:15.720954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 47 partNo 3 result is x0000000000_00000000000000000043_00000_0000000003_00015? size 8295638
2025-10-15T09:26:15.720968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-15T09:26:15.720977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00000_0000000003_00015? new key d0000000000_00000000000000000043_00000_0000000003_00015? size 8295638 WTime 1760520375720
2025-10-15T09:26:15.721066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 1 NewHead: Offset 46 PartNo 3 PackedSize 717145 count 1 nextOffset 47 batches 2
2025-10-15T09:26:15.721075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-15T09:26:15.721078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-15T09:26:15.721081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-15T09:26:15.721083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-15T09:26:15.721088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-15T09:26:15.721501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 3 PackedSize 2970343 count 2 nextOffset 48 batches 6
2025-10-15T09:26:15.721518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.721586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 46,2 HeadOffset 43 endOffset 43 curOffset 48 d0000000000_00000000000000000046_00003_0000000002_00005? size 2970333 WTime 1760520375721
2025-10-15T09:26:15.721921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.721934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.721936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.721939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes
2025-10-15T09:26:15.721987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
2025-10-15T09:26:15.722076Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T09:26:15.722087Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 0 count 3 size 8295638
2025-10-15T09:26:15.722092Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 46 partNo 3 count 2 size 2970333
2025-10-15T09:26:15.722097Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00000_0000000003_00015?(+) to d0000000000_00000000000000000032_00000_0000000003_00015?(+)
2025-10-15T09:26:15.722102Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00003_0000000004_00014?(+) to d0000000000_00000000000000000035_00003_0000000004_00014?(+)
2025-10-15T09:26:15.722080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.722103Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00004_0000000004_00012|(+) to d0000000000_00000000000000000028_00004_0000000004_00012|(+)
2025-10-15T09:26:15.722108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T09:26:15.722110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.722116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.722121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.722129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T09:26:15.722135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 19 size 524288 endOffset 43 max time lag 0ms effective offset 14
2025-10-15T09:26:15.722151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 2 blobs, size 7988756 count 4 last offset 14, current partition end offset: 43
2025-10-15T09:26:15.722158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-15T09:26:15.722163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-10-15T09:26:15.722220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 1 count 1 parts_count 3 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.722228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 40 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.722231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 42 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T09:26:15.000000Z
2025-10-15T09:26:15.722238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 3 from KV
2025-10-15T09:26:15.722243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.722244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.722247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 14. Have to read 2 of 2 from KV
2025-10-15T09:26:15.722250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 2 parts 8 suffix '63'
2025-10-15T09:26:15.722254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 42 partno 0 count 1 parts 4 suffix '63'
2025-10-15T09:26:15.722257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 1 count 1 parts_count 3
2025-10-15T09:26:15.722262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T09:26:15.722265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-15T09:26:15.722265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.722306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 50 to 50
2025-10-15T09:26:15.722603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.722615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-15T09:26:15.723733Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.723830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 17 queued_in_partition_duration_ms: 12 }
2025-10-15T09:26:15.723845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: acknoledged message 43
2025-10-15T09:26:15.724334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.724461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.724477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.724550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-10-15T09:26:15.724602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-10-15T09:26:15.724598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.724652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-10-15T09:26:15.724700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-10-15T09:26:15.724741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-10-15T09:26:15.724750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-10-15T09:26:15.724772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.724778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.724785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.724805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.724817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-10-15T09:26:15.724886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.726437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.726451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.726506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 99 size: 511959
2025-10-15T09:26:15.726557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 99 size: 511959
2025-10-15T09:26:15.726602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 99 size: 511959
2025-10-15T09:26:15.726650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 99 size: 511959
2025-10-15T09:26:15.726689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size: 205040
2025-10-15T09:26:15.726697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size 205040 offset: -1
2025-10-15T09:26:15.726708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.726722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.726750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 51 to 51
2025-10-15T09:26:15.727104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.727115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-15T09:26:15.728284Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.728730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.729005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.729165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.729175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.729193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 51
2025-10-15T09:26:15.729243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.730888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.730900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.730951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 101 size: 511959
2025-10-15T09:26:15.730993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 101 size: 511959
2025-10-15T09:26:15.731038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 101 size: 511959
2025-10-15T09:26:15.731091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 101 size: 511959
2025-10-15T09:26:15.731136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 101 size: 205040
2025-10-15T09:26:15.731145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 101 size 205040 offset: -1
2025-10-15T09:26:15.731160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.731176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.731581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 52 to 52
2025-10-15T09:26:15.731853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.731865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-15T09:26:15.732207Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.732726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.733587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.733906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.734049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.734064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.734089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 52
2025-10-15T09:26:15.734160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.735331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write 1 messages with Id from 53 to 53
2025-10-15T09:26:15.735616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: try to update token
2025-10-15T09:26:15.735627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-15T09:26:15.735849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.735864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.735920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 103 size: 511959
2025-10-15T09:26:15.735961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 103 size: 511959
2025-10-15T09:26:15.736009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 103 size: 511959
2025-10-15T09:26:15.736054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 103 size: 511959
2025-10-15T09:26:15.736092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 103 size: 205040
2025-10-15T09:26:15.736098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 103 size 205040 offset: -1
2025-10-15T09:26:15.736116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.736137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.736866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T09:26:15.736909Z :NOTICE: [/Invalid] [/Invalid] [65af8754-c35b0390-beb2e278-7167d550] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:11982" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:11982. " }
2025-10-15T09:26:15.737378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.737710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:15.737832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.737845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.737872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 53
2025-10-15T09:26:15.737976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.739687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.739699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.739747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 105 size: 511959
2025-10-15T09:26:15.739789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 1 messageNo: 105 size: 511959
2025-10-15T09:26:15.739832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 2 messageNo: 105 size: 511959
2025-10-15T09:26:15.739878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 3 messageNo: 105 size: 511959
2025-10-15T09:26:15.739910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 105 size: 205040
2025-10-15T09:26:15.739917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 105 size 205040 offset: -1
2025-10-15T09:26:15.739931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T09:26:15.739948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T09:26:15.749769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T09:26:15.749782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T09:26:15.749783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T09:26:15.749792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.749794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.749837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T09:26:15.749844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T09:26:15.749848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T09:26:15.749851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T09:26:15.750140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-15T09:26:15.752214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-15T09:26:15.752373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.752486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.752638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T09:26:15.752758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.752872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.752985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.753137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T09:26:15.753258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.753379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.753495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.753863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-15T09:26:15.754021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.754136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.754255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T09:26:15.754317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-15T09:26:15.754358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 7988738 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.754365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 7988756 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T09:26:15.754369Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.754381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 3 from KV. Status 1
2025-10-15T09:26:15.754386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T09:26:15.754391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 1741189 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.754427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T09:26:15.754495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 14
2025-10-15T09:26:15.754517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.754524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.754629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T09:26:15.754749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-15T09:26:15.754863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-15T09:26:15.755164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
2025-10-15T09:26:15.912798Z node 2 :PERSQUEUE CRIT: actor.h:46: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
??+0 (0x14940C3F)
??+0 (0x14940BE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x156A669D)
NKikimr::NPQ::TPartitionedBlob::CreateFormedBlob(unsigned int, bool)+2949 (0x244E1F05)
NKikimr::NPQ::TPartitionedBlob::Add(NKikimr::NPQ::TClientBlob&&)+213 (0x244E2665)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+3114 (0x245CCA7A)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x245D1BB5)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3979 (0x245D314B)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+5681 (0x2447EFE1)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x156526F8)
??+0 (0x14940C3F)
??+0 (0x14940E14)
std::rethrow_exception(std::exception_ptr)+12 (0x1495218C)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x174593B1)
2025-10-15T09:26:15.913206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 43 count 3 size 8295638 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.913213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 46 count 2 size 2970333 actorID [2:7561377435865718300:2392]
2025-10-15T09:26:15.913262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T09:26:15.913274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 43 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T09:26:15.913280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.913283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 46 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-15T09:26:15.915834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 40 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T09:26:15.915844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 6759616 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T09:26:15.915848Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T09:26:15.915935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_2446032429636071904_v1
2025-10-15T09:26:15.915946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915950Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101 requestId: <none> error: tablet will be restarted right now
2025-10-15T09:26:15.915975Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_2446032429636071904_v1
2025-10-15T09:26:15.919111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T09:26:15.919162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T09:26:15.919224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0
2025-10-15T09:26:15.919449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0 is DEAD
2025-10-15T09:26:15.919617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-15T09:26:15.919629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session will restart in 0.009498s
2025-10-15T09:26:15.919655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: Do CDS request
2025-10-15T09:26:15.919660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Start write session. Will connect to endpoint: localhost:11982
2025-10-15T09:26:15.922249Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 43 Result { Offset: 14 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 15 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375512 CreateTimestampMS: 1760520375475 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 16 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375513 CreateTimestampMS: 1760520375479 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 17 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375532 CreateTimestampMS: 1760520375483 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 18 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760520375533 CreateTimestampMS: 1760520375485 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 18446744073708527972 RealReadOffset: 17 WaitQuotaTimeMs: 0 EndOffset: 43 StartOffset: 0 } Cookie: 14 }
2025-10-15T09:26:15.923387Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 18 endOffset 43
2025-10-15T09:26:15.923412Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 43 ReadOffset 18 ReadGuid 59cf3d09-e1347c1d-c68c7d8e-84cb78c3 has messages 1
2025-10-15T09:26:15.923446Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 18, endOffset# 43, WTime# 1760520375533, sizeLag# 18446744073708527972
2025-10-15T09:26:15.923455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561377437562023778:2477]
2025-10-15T09:26:15.923461Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1TEvPartitionReady. Aval parts: 0
2025-10-15T09:26:15.923484Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 read done: guid# 59cf3d09-e1347c1d-c68c7d8e-84cb78c3, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011868
2025-10-15T09:26:15.923501Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 response to read: guid# 59cf3d09-e1347c1d-c68c7d8e-84cb78c3
2025-10-15T09:26:15.926033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T09:26:15.926340Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 Process answer. Aval parts: 1
2025-10-15T09:26:15.926397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T09:26:15.926550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T09:26:15.926561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T09:26:15.926569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T09:26:15.926607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T09:26:15.926643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561377435865718593:2411]
2025-10-15T09:26:15.927308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T09:26:15.927572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T09:26:15.927610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T09:26:15.928014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T09:26:15.928068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T09:26:15.928074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T09:26:15.928075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T09:26:15.928076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T09:26:15.928077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T09:26:15.928079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T09:26:15.928080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T09:26:15.928081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T09:26:15.928083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T09:26:15.928084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T09:26:15.928085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T09:26:15.928086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.928087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.928090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.928091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[14]: d0000000000_00000000000000000043_00000_0000000003_00015?
2025-10-15T09:26:15.928092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[15]: d0000000000_00000000000000000046_00003_0000000002_00005?
2025-10-15T09:26:15.928097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T09:26:15.928108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T09:26:15.928112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T09:26:15.928116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T09:26:15.928120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T09:26:15.928124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T09:26:15.928128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T09:26:15.928132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T09:26:15.928136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T09:26:15.928140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T09:26:15.928144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T09:26:15.928148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.928155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.928160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.928164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000043_00000_0000000003_00015?
2025-10-15T09:26:15.928168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000046_00003_0000000002_00005?
2025-10-15T09:26:15.928177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T09:26:15.928184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T09:26:15.928206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T09:26:15.928218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T09:26:15.928223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T09:26:15.928229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T09:26:15.928233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T09:26:15.928239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T09:26:15.928244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T09:26:15.928250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T09:26:15.928254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T09:26:15.928260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T09:26:15.928266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T09:26:15.928271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T09:26:15.928276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T09:26:15.928282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T09:26:15.928287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T09:26:15.928292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T09:26:15.928296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T09:26:15.928302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988756 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T09:26:15.928311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T09:26:15.928316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T09:26:15.928320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.928325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 1741189 so 0 eo 40 d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.928335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.928340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 40 count 2 size 4506418 so 0 eo 42 d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.928348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.928353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 42 count 1 size 2253220 so 0 eo 43 d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.928357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000043_00000_0000000003_00015?
2025-10-15T09:26:15.928366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 43 count 3 size 8295638 so 0 eo 46 d0000000000_00000000000000000043_00000_0000000003_00015?
2025-10-15T09:26:15.928370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000046_00003_0000000002_00005?
2025-10-15T09:26:15.928375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 46 count 2 size 2970333 so 0 eo 48 d0000000000_00000000000000000046_00003_0000000002_00005?
2025-10-15T09:26:15.928423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T09:26:15.929114Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Got ReadResponse, serverBytesSize = 9011868, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487580
2025-10-15T09:26:15.929206Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (14-14)
2025-10-15T09:26:15.929223Z :DEBUG: [/Root] [/Root] [3250696d-a1a63aeb-3fd5e303-2e25d08] [] Returning serverBytesSize = 9011868 to budget
2025-10-15T09:26:15.930065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T09:26:15.930141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T09:26:15.930156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-15T09:26:15.930269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T09:26:15.930299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:34640
2025-10-15T09:26:15.930309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:34640 proto=v1  topic=test-topic durationSec=0
2025-10-15T09:26:15.930313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T09:26:15.930712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-15T09:26:15.930743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T09:26:15.930751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T09:26:15.930753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T09:26:15.930758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561377437562023943:2481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T09:26:15.931238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561377437562023943:2481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T09:26:15.933118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561377437562023943:2481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T09:26:15.936199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561377437562023943:2481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T09:26:15.936212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561377437562023943:2481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T09:26:15.936214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561377437562023943:2481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T09:26:15.936220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T09:26:15.936876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:916: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 48 key 36,3 valuesize 6759616 expected 6759616
2025-10-15T09:26:15.938596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T09:26:15.938611Z node 2 :PERSQUEUE INFO: partition_init.cpp:965: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T09:26:15.938614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T09:26:15.938618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T09:26:15.938624Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7561377435865718593:2411]
2025-10-15T09:26:15.938638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 48 Head Offset 48 PartNo 0 PackedSize 0 count 0 nextOffset 48 batches 0
SYNC INIT sourceId  src_id seqNo 48 offset 47
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000040_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000042_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000043_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000046_00003_0000000002_00005? size 2970333
2025-10-15T09:26:15.938654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4311: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T09:26:15.938656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.938659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.938661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.938677Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 48 offset: 47 MaxOffset: 48
2025-10-15T09:26:15.938683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T09:26:15.938688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T09:26:15.938744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.938752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.938755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.938758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes
2025-10-15T09:26:15.938832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T09:26:15.938839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.938851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000002_00008?
2025-10-15T09:26:15.938867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000042_00000_0000000001_00004?
2025-10-15T09:26:15.938887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T09:26:15.938907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023920:2437], now have 1 active actors on pipe
2025-10-15T09:26:15.938914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561377437562023978:2481], now have 1 active actors on pipe
2025-10-15T09:26:15.938921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 1 count 1 parts_count 3 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.938928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 40 partno 0 count 2 parts_count 8 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.938930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 42 partno 0 count 1 parts_count 4 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.938942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-15T09:26:15.938916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-15T09:26:15.938924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-15T09:26:15.938954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 48 max time lag 0ms effective offset 0
2025-10-15T09:26:15.938959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 1 count 1 parts_count 3
2025-10-15T09:26:15.938961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 40 partno 0 count 2 parts_count 8
2025-10-15T09:26:15.938962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 42 partno 0 count 1 parts_count 4
2025-10-15T09:26:15.938972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 48
2025-10-15T09:26:15.938974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T09:26:15.939012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.939020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.939030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.939041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T09:26:15.939047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T09:26:15.939067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5020ef9f-6302a0b1-96ba1cf3-216cb567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T09:26:15.939076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T09:26:15.939079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T09:26:15.939082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T09:26:15.939089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T09:26:15.939101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T09:26:15.939121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.939247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T09:26:15.939255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T09:26:15.939266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T09:26:15.939338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 48 sessionId: src_id|5020ef9f-6302a0b1-96ba1cf3-216cb567_0
2025-10-15T09:26:15.939665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb54f9a-82eeed65-ee0087a2-c07684dd_0] Write session established. Init response: last_sequence_number: 48 session_id: "src_id|5020ef9f-6302a0b1-96ba1cf3-216cb567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T09:26:15.942231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5020ef9f-6302a0b1-96ba1cf3-216cb567_0] Write session: try to update token
2025-10-15T09:26:15.942249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5020ef9f-6302a0b1-96ba1cf3-216cb567_0] Send 10 message(s) (0 left), first sequence number is 44
2025-10-15T09:26:15.951026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-15T09:26:15.951047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T09:26:15.951049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T09:26:15.951051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T09:26:15.951059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 1741189 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.951064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 40 count 2 size 4506418 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.951068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 42 count 1 size 2253220 actorID [2:7561377435865718586:2411]
2025-10-15T09:26:15.951102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T09:26:15.951104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T09:26:15.951109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T09:26:15.951110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 42 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T09:26:15.951114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T09:26:15.951119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T09:26:15.951123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 42 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T09:26:15.951249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T09:26:15.951272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:446: [72075186224037892][Partition][0][StateIdle] Can't append blob for key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T09:26:15.961800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|5020ef9f-6302a0b1-96ba1cf3-216cb567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T09:26:15.964404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T09:26:16.023550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 18 EndOffset 43 InitDone 1 WaitForData 0, pipe: [1:7561377441856991281:2477]
2025-10-15T09:26:16.023885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2446032429636071904_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7561377441856991281:2477]
VERIFY failed (2025-10-15T09:26:15.951279Z): Something went wrong
  ydb/core/persqueue/pqtablet/partition/partition_compaction.cpp:447
  BlobsForCompactionWereRead(): requirement false failed
NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char, std::__y1::char_traits<char>>, char const*, unsigned long)+438 (0x14A449A6)
NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...)+263 (0x14A3B247)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+7690 (0x245D3FCA)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+5681 (0x2447EFE1)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x156526F8)
NActors::TExecutorThread::Execute(NActors::TMailbox*, bool)+3317 (0x156960B5)
??+0 (0x1569A1C3)
NActors::TExecutorThread::ProcessExecutorPool()+657 (0x15699DD1)
NActors::TExecutorThread::ThreadProc()+191 (0x1569A9BF)
??+0 (0x14A468FD)
??+0 (0x7F4EB4E25AC3)
??+0 (0x7F4EB4EB78C0)
