2025-10-13T18:20:53.914375Z :PropagateSessionClosed INFO: Random seed for debugging is 1760379653914369
2025-10-13T18:20:54.008306Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7560773045322388598:2089];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:20:54.008324Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-13T18:20:54.012367Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-13T18:20:54.013399Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7560773045899367704:2156];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:20:54.013421Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/0mng/00019a/r3tmp/tmpbfRG6u/pdisk_1.dat
2025-10-13T18:20:54.015695Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-13T18:20:54.057677Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-13T18:20:54.078256Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-13T18:20:54.096842Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 20438, node 1
2025-10-13T18:20:54.108284Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-13T18:20:54.108313Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-13T18:20:54.110351Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-13T18:20:54.115247Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-13T18:20:54.115290Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-13T18:20:54.116354Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/0mng/00019a/r3tmp/yandexDAuI7m.tmp
2025-10-13T18:20:54.116368Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/0mng/00019a/r3tmp/yandexDAuI7m.tmp
2025-10-13T18:20:54.116438Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/0mng/00019a/r3tmp/yandexDAuI7m.tmp
2025-10-13T18:20:54.116469Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-13T18:20:54.116705Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-13T18:20:54.116990Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-13T18:20:54.119383Z INFO: TTestServer started on Port 4273 GrpcPort 20438
TClient is connected to server localhost:4273
PQClient connected to localhost:20438
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-13T18:20:54.148747Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-13T18:20:54.314092Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-13T18:20:54.345129Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-13T18:20:54.469440Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7560773045899367926:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:20:54.469440Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7560773045899367908:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:20:54.469467Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:20:54.469536Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7560773045899367937:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:20:54.469550Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:20:54.470999Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-13T18:20:54.476190Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7560773045899367936:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-13T18:20:54.526539Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-13T18:20:54.526985Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7560773045322389593:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-13T18:20:54.527170Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=ODg0MTVmNTAtNTZmYWRjMTctYzg1OGVlNWMtMzI3NmFmYmE=, ActorId: [1:7560773045322389549:2322], ActorState: ExecuteState, TraceId: 01k7fcvmacbzbqhpgtfy8wzpwq, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-13T18:20:54.527746Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-13T18:20:54.556127Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-13T18:20:54.575781Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7560773045899368029:2172] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-13T18:20:54.578430Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-13T18:20:54.580539Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7560773045899368043:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-13T18:20:54.580631Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZDNkNTUyNi1hMTE4ZWRkOS1hM2MzZjA4LWRiZjM4NDc5, ActorId: [2:7560773045899367904:2294], ActorState: ExecuteState, TraceId: 01k7fcvma4ck56y62ag6546q02, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-13T18:20:54.580792Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:20438", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-13T18:20:54.618690Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k7fcvme3aqqp650v1jrxs4d0, Database: , SessionId: ydb://session/3?node_id=1&id=ZThjMTQ3OGYtZDJhYWYyZDUtYzAxY2UwZjEtYTVmYTQ5YWQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7560773045322389983:2934] 
2025-10-13T18:20:55.010757Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-13T18:20:55.014842Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-13T18:20:59.008494Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7560773045322388598:2089];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:20:59.008588Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-13T18:20:59.013561Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7560773045899367704:2156];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:20:59.013602Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-13T18:20:59.824495Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720670:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:20438
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-13T18:20:59.853734Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:20438
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720671
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-13T18:20:59.865815Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7560773066797226876:3198] connected; active server actors: 1
2025-10-13T18:20:59.865893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-13T18:20:59.866059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-13T18:20:59.868212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-13T18:20:59.868938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-13T18:20:59.868990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-13T18:20:59.868998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-13T18:20:59.869013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-13T18:20:59.869160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773066797226875:3197], now have 1 active actors on pipe
2025-10-13T18:20:59.869164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773066797226905:2427], now have 1 active actors on pipe
2025-10-13T18:20:59.869490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:20:59.870755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:20:59.872266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-13T18:20:59.872318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-13T18:20:59.874979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773066797226932:3243], now have 1 active actors on pipe
2025-10-13T18:20:59.875058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:20:59.876530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:20:59.876750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-13T18:20:59.876770Z node 2 :PERSQUEUE DEBUG: partition.cpp:1281: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-13T18:20:59.876826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-13T18:20:59.876892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7560773067374204936:2389]
2025-10-13T18:20:59.877570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-13T18:20:59.877573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-13T18:20:59.877579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7560773067374204936:2389]
2025-10-13T18:20:59.877586Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-13T18:20:59.877888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4310: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-13T18:20:59.877895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:20:59.877920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.877923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:20:59.877926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-13T18:20:59.877928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.877929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.877930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-13T18:20:59.877937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-13T18:20:59.878012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:20:59.878054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:20:59.879987Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720672. Ctx: { TraceId: 01k7fcvsjm3d20rjj45tj8wt46, Database: , SessionId: ydb://session/3?node_id=1&id=NGY1ODUzODQtYWJhYTM3YzktNmY1NTkzLWUxOWY3YTNi, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-13T18:20:59.880892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:20:59.880965Z node 2 :PERSQUEUE DEBUG: partition.cpp:1385: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760379659920, TxId 281474976720671
2025-10-13T18:20:59.880986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.880988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.881024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:20:59.881088Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: 2025-10-13T18:20:59.884142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:20:59.884241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:20:59.884250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:20:59.884252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.884255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:20:59.884263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:20:59.884380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-13T18:20:59.884403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-13T18:20:59.884466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:20:59.887023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:20:59.887048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720671
    CreateStep: 1760379659920
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720671
    CreateStep: 1760379659920
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:20438
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-13T18:20:59.889736Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-13T18:20:59.891118Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-13T18:20:59.891344Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-13T18:20:59.891351Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:20438
2025-10-13T18:20:59.888056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:20:59.893555Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-13T18:20:59.896208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-13T18:20:59.896224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-13T18:20:59.896356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-13T18:20:59.896398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:45556
2025-10-13T18:20:59.896404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45556 proto=v1  topic=test-topic durationSec=0
2025-10-13T18:20:59.896407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-13T18:20:59.896853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-13T18:20:59.896902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-13T18:20:59.896904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-13T18:20:59.896906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-13T18:20:59.896913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-13T18:20:59.897473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-13T18:20:59.930918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-13T18:20:59.931037Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773066797227036:2442] connected; active server actors: 1
2025-10-13T18:20:59.931064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-13T18:20:59.931070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-13T18:20:59.931152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773066797227036:2442] disconnected.
2025-10-13T18:20:59.931162Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773066797227036:2442] disconnected; active server actors: 1
2025-10-13T18:20:59.931165Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773066797227036:2442] disconnected no session
2025-10-13T18:20:59.949524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-13T18:20:59.949541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-13T18:20:59.949544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7560773066797227005:2442] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-13T18:20:59.949553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-13T18:20:59.949947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-13T18:20:59.951596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d448b65e-c8603256-4faf0bde-d4833b67_0
2025-10-13T18:20:59.949876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773066797227059:2442], now have 1 active actors on pipe
2025-10-13T18:20:59.950022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:20:59.950034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:20:59.950069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d448b65e-c8603256-4faf0bde-d4833b67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-13T18:20:59.950080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:20:59.950086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.950089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:20:59.950102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:20:59.950131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-13T18:20:59.950153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:20:59.951426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:20:59.951434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:20:59.951459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:20:59.952071Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760379659952 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-13T18:20:59.952117Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d448b65e-c8603256-4faf0bde-d4833b67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-13T18:20:59.952302Z :INFO: [] MessageGroupId [src] SessionId [src|d448b65e-c8603256-4faf0bde-d4833b67_0] Write session: close. Timeout = 0 ms
2025-10-13T18:20:59.952313Z :INFO: [] MessageGroupId [src] SessionId [src|d448b65e-c8603256-4faf0bde-d4833b67_0] Write session will now close
2025-10-13T18:20:59.952323Z :DEBUG: [] MessageGroupId [src] SessionId [src|d448b65e-c8603256-4faf0bde-d4833b67_0] Write session: aborting
2025-10-13T18:20:59.952564Z :INFO: [] MessageGroupId [src] SessionId [src|d448b65e-c8603256-4faf0bde-d4833b67_0] Write session: gracefully shut down, all writes complete
2025-10-13T18:20:59.952575Z :DEBUG: [] MessageGroupId [src] SessionId [src|d448b65e-c8603256-4faf0bde-d4833b67_0] Write session: destroy
2025-10-13T18:20:59.952669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d448b65e-c8603256-4faf0bde-d4833b67_0 grpc read done: success: 0 data: 
2025-10-13T18:20:59.952678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d448b65e-c8603256-4faf0bde-d4833b67_0 grpc read failed
2025-10-13T18:20:59.952686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d448b65e-c8603256-4faf0bde-d4833b67_0 grpc closed
2025-10-13T18:20:59.952690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d448b65e-c8603256-4faf0bde-d4833b67_0 is DEAD
2025-10-13T18:20:59.953464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-13T18:20:59.953593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7560773066797227059:2442] destroyed
2025-10-13T18:20:59.953623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-13T18:20:59.953631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:20:59.953634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.953636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-13T18:20:59.980470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:20:59.980491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:20:59.980494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-13T18:21:00.013429Z :INFO: [/Root] [] [89276730-c0902ad6-16028d7e-c1dd774e] Open read subsessions to databases: { name: dc1, endpoint: localhost:20438, path: /Root }, { name: dc2, endpoint: localhost:20438, path: /Invalid }
2025-10-13T18:21:00.015444Z :INFO: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] Starting read session
2025-10-13T18:21:00.015469Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] Starting single session
2025-10-13T18:21:00.015484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-13T18:21:00.015668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-13T18:21:00.015690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:20438
2025-10-13T18:21:00.015763Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.015769Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.015774Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Reconnecting session to cluster  in 0.000000s
2025-10-13T18:21:00.017426Z :INFO: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Starting read session
2025-10-13T18:21:00.017436Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Starting single session
2025-10-13T18:21:00.017464Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.017468Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.017472Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] Reconnecting session to cluster  in 0.000000s
2025-10-13T18:21:00.017507Z :ERROR: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. 
2025-10-13T18:21:00.017512Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.017515Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.017545Z :INFO: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.080598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.080616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.080619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.180968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.180988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.180991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.200932Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-13T18:21:00.200945Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-13T18:21:00.200985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-13T18:21:00.200990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-13T18:21:00.204008Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Successfully connected. Initializing session
2025-10-13T18:21:00.204283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:21:00.204531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:21:00.204583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:45578
2025-10-13T18:21:00.204589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45578 proto=v1  topic=test-topic durationSec=0
2025-10-13T18:21:00.204594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-13T18:21:00.205179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-13T18:21:00.205214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-13T18:21:00.205216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-13T18:21:00.205219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-13T18:21:00.205225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-13T18:21:00.205745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-13T18:21:00.205866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-13T18:21:00.205954Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read init: from# ipv6:[::1]:45578, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-13T18:21:00.206042Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 auth for : user
2025-10-13T18:21:00.206218Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Handle describe topics response
2025-10-13T18:21:00.206237Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 auth is DEAD
2025-10-13T18:21:00.206248Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 auth ok: topics# 1, initDone# 0
2025-10-13T18:21:00.206706Z :INFO: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got InitResponse. ReadSessionId: shared/user_1_1_16580020182907490963_v1
2025-10-13T18:21:00.206723Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:21:00.206496Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 register session: topic# rt3.dc1--test-topic
2025-10-13T18:21:00.206809Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.206858Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773071092194394:2463] connected; active server actors: 1
2025-10-13T18:21:00.206996Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1704: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7560773071092194394:2463] session shared/user_1_1_16580020182907490963_v1
2025-10-13T18:21:00.207007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-13T18:21:00.207019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-13T18:21:00.207031Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_16580020182907490963_v1" (Sender=[1:7560773071092194383:2463], Pipe=[1:7560773071092194394:2463], Partitions=[], ActiveFamilyCount=0)
2025-10-13T18:21:00.207035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-13T18:21:00.207047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-13T18:21:00.207056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_16580020182907490963_v1" (Sender=[1:7560773071092194383:2463], Pipe=[1:7560773071092194394:2463], Partitions=[], ActiveFamilyCount=0)
2025-10-13T18:21:00.207064Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_16580020182907490963_v1" sender [1:7560773071092194383:2463] lock partition 0 for ReadingSession "shared/user_1_1_16580020182907490963_v1" (Sender=[1:7560773071092194383:2463], Pipe=[1:7560773071092194394:2463], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-13T18:21:00.207073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-13T18:21:00.207077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000027s
2025-10-13T18:21:00.207109Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-13T18:21:00.207309Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_16580020182907490963_v1" ClientId: "user" PipeClient { RawX1: 7560773071092194394 RawX2: 4503603922340255 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-13T18:21:00.207331Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# 63e6f338-73ba6f6c-b5ac368e-f2751071
2025-10-13T18:21:00.207436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-13T18:21:00.207805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773071092194402:2470], now have 1 active actors on pipe
2025-10-13T18:21:00.208604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7560773071092194402:2470]
2025-10-13T18:21:00.209037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.209054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.209068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_16580020182907490963_v1 on pipe: [1:7560773071092194402:2470]
2025-10-13T18:21:00.209099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.209107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.209111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:21:00.209123Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_16580020182907490963_v1:1 with generation 1
2025-10-13T18:21:00.209148Z node 2 :PERSQUEUE DEBUG: partition.cpp:3708: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_16580020182907490963_v1
2025-10-13T18:21:00.209151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.209204Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.210733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.210764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.210773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.210775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.210777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.210783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.210794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-13T18:21:00.210377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-13T18:21:00.210499Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773071092194412:2464] connected; active server actors: 1
2025-10-13T18:21:00.210511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-13T18:21:00.210516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-13T18:21:00.210613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773071092194412:2464] disconnected.
2025-10-13T18:21:00.210617Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773071092194412:2464] disconnected; active server actors: 1
2025-10-13T18:21:00.210620Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560773071092194412:2464] disconnected no session
2025-10-13T18:21:00.211140Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760379660180 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-13T18:21:00.211173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-13T18:21:00.211198Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 sending to client partition status
2025-10-13T18:21:00.216625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-13T18:21:00.216641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-13T18:21:00.216645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7560773071092194386:2464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-13T18:21:00.216654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-13T18:21:00.217929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-13T18:21:00.219261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773071092194429:2464], now have 1 active actors on pipe
2025-10-13T18:21:00.219296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.219317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.219349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-13T18:21:00.219366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.219372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.219375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:21:00.219386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.219401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-13T18:21:00.219417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:21:00.219978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.219994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.220014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:21:00.220380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0
2025-10-13T18:21:00.220803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760379660220 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-13T18:21:00.220843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|85598e75-571cd69d-857c9de3-823ce0a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-13T18:21:00.222743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 1 to 1
2025-10-13T18:21:00.224498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.224517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-13T18:21:00.227415Z :INFO: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-13T18:21:00.230051Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-13T18:21:00.230148Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-13T18:21:00.230165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.230169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-13T18:21:00.230177Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-13T18:21:00.233171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.233389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.233413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.233459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-13T18:21:00.233576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.233921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 2 to 2
2025-10-13T18:21:00.235689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.235705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-13T18:21:00.236468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.236487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.236986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-13T18:21:00.237364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-13T18:21:00.237483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-13T18:21:00.238486Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-13T18:21:00.238500Z :DEBUG: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.237538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-13T18:21:00.237603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-13T18:21:00.237610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-13T18:21:00.237633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.237659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.237670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.237673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:21:00.237711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-13T18:21:00.237723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-13T18:21:00.237726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-13T18:21:00.237729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-13T18:21:00.237732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-13T18:21:00.238823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-13T18:21:00.238838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.238942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760379660238
2025-10-13T18:21:00.241741Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.241771Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-13T18:21:00.241316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.243265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.243458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.243486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.243522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-13T18:21:00.243811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 3 to 3
2025-10-13T18:21:00.244477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.245656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.245676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-13T18:21:00.246801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.246823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.246980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-13T18:21:00.247054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-13T18:21:00.247505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-13T18:21:00.247961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-13T18:21:00.248014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-13T18:21:00.248024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-13T18:21:00.248125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.248405Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.248413Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-13T18:21:00.248433Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-13T18:21:00.248462Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-13T18:21:00.248465Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:21:00.248494Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 799490ab-e7ff1ddf-96e87128-af1d1b1e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.248531Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 799490ab-e7ff1ddf-96e87128-af1d1b1e
2025-10-13T18:21:00.250005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.250339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 5 }
2025-10-13T18:21:00.250354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 1
2025-10-13T18:21:00.250342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.250657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.251984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.248158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.248177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.248196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.248215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.248220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.248229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:21:00.248231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-13T18:21:00.248234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.248239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-13T18:21:00.248241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.248245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-13T18:21:00.248247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.248251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-13T18:21:00.248256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.248259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-13T18:21:00.248314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-13T18:21:00.248323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-13T18:21:00.248327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.248336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.248339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:21:00.248365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-13T18:21:00.248375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-13T18:21:00.248378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-13T18:21:00.248382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-13T18:21:00.248385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-13T18:21:00.249394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-13T18:21:00.249412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.249532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760379660243
2025-10-13T18:21:00.249829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.249880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-13T18:21:00.249932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.249938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.249954Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.249970Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-13T18:21:00.250040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-13T18:21:00.250057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-13T18:21:00.250061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-13T18:21:00.250095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.250106Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-13T18:21:00.250118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-13T18:21:00.250128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-13T18:21:00.250132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-13T18:21:00.250142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.250144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.250399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.250559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.250795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.250935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.251084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:21:00.251114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.251125Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-13T18:21:00.251141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.251146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.251148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.251158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760379660237 queuesize 0 startOffset 0
2025-10-13T18:21:00.251175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.251331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.251462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.251590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.251718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.251770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:21:00.251810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:21:00.251822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-13T18:21:00.254935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 4 to 4
2025-10-13T18:21:00.255222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.255255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-13T18:21:00.256455Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.257506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.257934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.258391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.258415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.258592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-13T18:21:00.258660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-13T18:21:00.258723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-13T18:21:00.258788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-13T18:21:00.258834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-13T18:21:00.258839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-13T18:21:00.258900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.258904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.258919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.258946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.259137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-13T18:21:00.259959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.259988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.260007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.260009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:21:00.260013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.260174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 5 to 5
2025-10-13T18:21:00.259588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.260306Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660237 CreateTimestampMS: 1760379660220 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-13T18:21:00.261226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.262117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.262134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-13T18:21:00.262278Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-13T18:21:00.262302Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 799490ab-e7ff1ddf-96e87128-af1d1b1e has messages 1
2025-10-13T18:21:00.262351Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# 799490ab-e7ff1ddf-96e87128-af1d1b1e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252974
2025-10-13T18:21:00.262365Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# 799490ab-e7ff1ddf-96e87128-af1d1b1e
2025-10-13T18:21:00.263356Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.263481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 16 }
2025-10-13T18:21:00.263514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 2
2025-10-13T18:21:00.260023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-13T18:21:00.260046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.260051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-13T18:21:00.260052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.260055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-13T18:21:00.260057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.260061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-13T18:21:00.260066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.260069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-13T18:21:00.260110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.260120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.260123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:21:00.260148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-13T18:21:00.260161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-13T18:21:00.260164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-13T18:21:00.260169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-13T18:21:00.260172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-13T18:21:00.263531Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-13T18:21:00.263549Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-13T18:21:00.260682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-13T18:21:00.260697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.260804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1760379660260
2025-10-13T18:21:00.261082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.261107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-13T18:21:00.261136Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.261148Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-13T18:21:00.263022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.263030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.263103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-13T18:21:00.263152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-13T18:21:00.263208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-13T18:21:00.263260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-13T18:21:00.263296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-13T18:21:00.263300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-13T18:21:00.263360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.263379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.264005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.264372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.264553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.264566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.264591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-13T18:21:00.265136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.265150Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 0
2025-10-13T18:21:00.265190Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760379660237, sizeLag# 2253219
2025-10-13T18:21:00.265193Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:21:00.266645Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 2252974, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728686
2025-10-13T18:21:00.266753Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-13T18:21:00.266778Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 2252974 to budget
2025-10-13T18:21:00.266955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 6 to 6
2025-10-13T18:21:00.267212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.267224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-13T18:21:00.268478Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-13T18:21:00.268500Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.268509Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252974, ReadSizeServerDelta = -1728686
2025-10-13T18:21:00.268595Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.268607Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-13T18:21:00.220000Z WriteTime: 2025-10-13T18:21:00.237000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.269073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.269387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.269427Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252974 } }
2025-10-13T18:21:00.269556Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# f613916b-f06df53e-9b82f4be-3536e4f1
2025-10-13T18:21:00.269587Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 4808421f-ab90da1d-347b7bb0-dfaadad1, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.269611Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 4808421f-ab90da1d-347b7bb0-dfaadad1
2025-10-13T18:21:00.269710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.269056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.269077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.269162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-13T18:21:00.269216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-13T18:21:00.269272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-13T18:21:00.269322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-13T18:21:00.269357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-13T18:21:00.269362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-13T18:21:00.269405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.269428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.269608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.269612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.269630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-13T18:21:00.269827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.269837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.269890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 2 max time lag 0ms effective offset 1
2025-10-13T18:21:00.269916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 2
2025-10-13T18:21:00.269931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-13T18:21:00.269943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.269963Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-13T18:21:00.269968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.269981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.272761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 7 to 7
2025-10-13T18:21:00.273027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.273040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-13T18:21:00.275889Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-13T18:21:00.270475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.270643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.271058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.271220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.271456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:21:00.271584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-13T18:21:00.271608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.271630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:21:00.272567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.272577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.272651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-13T18:21:00.272702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-13T18:21:00.273045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-13T18:21:00.273644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-13T18:21:00.273688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-13T18:21:00.273692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.278175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.279215Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 2 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660243 CreateTimestampMS: 1760379660230 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 2 StartOffset: 0 } Cookie: 1 }
2025-10-13T18:21:00.276656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.276687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.276695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.276705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-13T18:21:00.276709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.276714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-13T18:21:00.276717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.276721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-13T18:21:00.276722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.276728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-13T18:21:00.276734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.276741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-13T18:21:00.276776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.276793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.276795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:21:00.276816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-13T18:21:00.276828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-13T18:21:00.276832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-13T18:21:00.276835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-13T18:21:00.276839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-13T18:21:00.277363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-13T18:21:00.277384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-13T18:21:00.277390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-13T18:21:00.277395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-13T18:21:00.277398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-13T18:21:00.277401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-13T18:21:00.278393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 4506426 count 2 nextOffset 5 batches 9
2025-10-13T18:21:00.278410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.278514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 3 endOffset 3 curOffset 5 d0000000000_00000000000000000003_00000_0000000002_00008? size 4506416 WTime 1760379660278
2025-10-13T18:21:00.280946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.282045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 8 to 8
2025-10-13T18:21:00.282055Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 2
2025-10-13T18:21:00.282080Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 2 ReadOffset 2 ReadGuid 4808421f-ab90da1d-347b7bb0-dfaadad1 has messages 1
2025-10-13T18:21:00.282133Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# 4808421f-ab90da1d-347b7bb0-dfaadad1, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-13T18:21:00.282151Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# 4808421f-ab90da1d-347b7bb0-dfaadad1
2025-10-13T18:21:00.283689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.283732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.283756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.283791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-13T18:21:00.283814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.283832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.283840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.283852Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.283868Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 2 size 4506416
2025-10-13T18:21:00.283930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-13T18:21:00.284034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.284068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-13T18:21:00.284664Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 0
2025-10-13T18:21:00.284780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.284809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.284951Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 2 EndOffset 2 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-13T18:21:00.284969Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-13T18:21:00.284987Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1760379660243, sizeLag# 2253219
2025-10-13T18:21:00.284991Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:21:00.285738Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-13T18:21:00.285847Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-13T18:21:00.285873Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 2252976 to budget
2025-10-13T18:21:00.286402Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-13T18:21:00.286423Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.286432Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-13T18:21:00.286471Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.286479Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-13T18:21:00.230000Z WriteTime: 2025-10-13T18:21:00.243000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.287502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.287517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.288052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-13T18:21:00.288109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-13T18:21:00.288168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-13T18:21:00.288210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 1 }
2025-10-13T18:21:00.288226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 3
2025-10-13T18:21:00.288237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-13T18:21:00.288295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-13T18:21:00.288308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-13T18:21:00.288331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.288352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.288798Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-13T18:21:00.288850Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# eb0d8500-a11c0c43-d1b34e5a-dd4d345b
2025-10-13T18:21:00.288868Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 4cb5f92c-34fcecca-188f2710-2d546d7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.288897Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 4cb5f92c-34fcecca-188f2710-2d546d7
2025-10-13T18:21:00.289679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.289987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.290927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 9 to 9
2025-10-13T18:21:00.289222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.289233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.289267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 3 max time lag 0ms effective offset 2
2025-10-13T18:21:00.289288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 3
2025-10-13T18:21:00.289292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-13T18:21:00.289301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.289312Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-13T18:21:00.289328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.289336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.289586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.289742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.290002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.290160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.290283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:21:00.290316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.290320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.290338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-13T18:21:00.292827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.292842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-13T18:21:00.293584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-13T18:21:00.294760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.295075Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.298046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.298064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.298139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-13T18:21:00.298201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-13T18:21:00.296259Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660259 CreateTimestampMS: 1760379660241 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 2 }
2025-10-13T18:21:00.296522Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 3
2025-10-13T18:21:00.296534Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 3 ReadGuid 4cb5f92c-34fcecca-188f2710-2d546d7 has messages 1
2025-10-13T18:21:00.296585Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# 4cb5f92c-34fcecca-188f2710-2d546d7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-13T18:21:00.296593Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# 4cb5f92c-34fcecca-188f2710-2d546d7
2025-10-13T18:21:00.296717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.297030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.298298Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 0
2025-10-13T18:21:00.298635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-13T18:21:00.298693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-13T18:21:00.298733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-13T18:21:00.298743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-13T18:21:00.298772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.298781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.298866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.298896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.298924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 4506416 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.298952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-13T18:21:00.298968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.298985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:21:00.298992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.298999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-13T18:21:00.299018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-13T18:21:00.299024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-13T18:21:00.299029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-13T18:21:00.299040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-13T18:21:00.299047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-13T18:21:00.299052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-13T18:21:00.299059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-13T18:21:00.299064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-13T18:21:00.299072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.299092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.299076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-13T18:21:00.299127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.299147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.299155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-13T18:21:00.299182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-13T18:21:00.299198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-13T18:21:00.299208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-13T18:21:00.299211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-13T18:21:00.299215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-13T18:21:00.299192Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 3 EndOffset 3 newEndOffset 5 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-10-13T18:21:00.299203Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 5
2025-10-13T18:21:00.299214Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 5, WTime# 1760379660259, sizeLag# 4506416
2025-10-13T18:21:00.299217Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:21:00.299701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-13T18:21:00.299731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-13T18:21:00.299737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-13T18:21:00.299741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-13T18:21:00.299745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-13T18:21:00.299749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-13T18:21:00.300405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-13T18:21:00.300433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-13T18:21:00.300440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-13T18:21:00.300444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-13T18:21:00.300448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-13T18:21:00.300451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-13T18:21:00.300694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 10 to 10
2025-10-13T18:21:00.300904Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-13T18:21:00.300998Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-13T18:21:00.301013Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 2252976 to budget
2025-10-13T18:21:00.301337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 6759623 count 3 nextOffset 8 batches 13
2025-10-13T18:21:00.301361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.301469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,3 HeadOffset 5 endOffset 5 curOffset 8 d0000000000_00000000000000000005_00000_0000000003_00012? size 6759613 WTime 1760379660301
2025-10-13T18:21:00.302524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.302539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-13T18:21:00.303705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-13T18:21:00.303718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-13T18:21:00.303721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-13T18:21:00.303724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-13T18:21:00.303727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 11266073 bytes
2025-10-13T18:21:00.303781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-13T18:21:00.303815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-13T18:21:00.304378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.304725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.304761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.304781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.304822Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-13T18:21:00.304842Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.304854Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-13T18:21:00.304576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.304597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.304716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-13T18:21:00.304833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-13T18:21:00.304889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-13T18:21:00.304947Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.304959Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.304945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-13T18:21:00.304989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-13T18:21:00.304993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-13T18:21:00.305016Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.305033Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 3 size 6759613
2025-10-13T18:21:00.305048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-13T18:21:00.305051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-13T18:21:00.305061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-13T18:21:00.305071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-13T18:21:00.305088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-13T18:21:00.305099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-13T18:21:00.305112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.305133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.305192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.305203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.305207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.305210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.305225Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-13T18:21:00.305260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.305265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.305268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.305270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:21:00.305278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.305283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.305409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-13T18:21:00.305542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-13T18:21:00.305680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-13T18:21:00.306005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-13T18:21:00.306082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-13T18:21:00.306315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 13 }
2025-10-13T18:21:00.306330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 4
2025-10-13T18:21:00.306658Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-13T18:21:00.306698Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# db3e532-7b084319-b89b816d-342b38ac
2025-10-13T18:21:00.306703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 8 }
2025-10-13T18:21:00.306712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 5
2025-10-13T18:21:00.306717Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# c39f65c7-2c97a83a-3909f3ff-a5317f2a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.306757Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid c39f65c7-2c97a83a-3909f3ff-a5317f2a
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-13T18:21:00.241000Z WriteTime: 2025-10-13T18:21:00.259000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.307593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-13T18:21:00.307615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.308156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-13T18:21:00.308305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-13T18:21:00.308458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-13T18:21:00.308597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-13T18:21:00.308682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-13T18:21:00.310031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-13T18:21:00.310047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.310169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-13T18:21:00.310305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-13T18:21:00.310443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-13T18:21:00.310585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-13T18:21:00.310651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-13T18:21:00.312327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-13T18:21:00.312347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.312493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-13T18:21:00.312646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-13T18:21:00.312794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-13T18:21:00.313299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-13T18:21:00.314425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 11 to 11
2025-10-13T18:21:00.314707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.314721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-13T18:21:00.317116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-13T18:21:00.317324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-13T18:21:00.317347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760379660317
2025-10-13T18:21:00.317462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-13T18:21:00.317486Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-13T18:21:00.317476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.317607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-13T18:21:00.317875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-13T18:21:00.318138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-13T18:21:00.318227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-13T18:21:00.318935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 3 PackedSize 2970341 count 2 nextOffset 5 batches 6
2025-10-13T18:21:00.319049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 0 endOffset 0 curOffset 5 d0000000000_00000000000000000003_00003_0000000002_00005| size 2970331 WTime 1760379660318
2025-10-13T18:21:00.319520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.319534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.319584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.319597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.319645Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.319667Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-13T18:21:00.319680Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 2 size 2970331
2025-10-13T18:21:00.319987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-13T18:21:00.320036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 2 size 524288 endOffset 5 max time lag 0ms effective offset 3
2025-10-13T18:21:00.320061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 4506416 count 2 last offset 3, current partition end offset: 5
2025-10-13T18:21:00.320070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-13T18:21:00.320082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.320089Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-13T18:21:00.320113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.320105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.320125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:21:00.320302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.320481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.321108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 12 to 12
2025-10-13T18:21:00.321388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.321407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-13T18:21:00.321929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.322246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.322656Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.320642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.321074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.321289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-13T18:21:00.321465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.322022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.322175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.322240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:21:00.323719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.323749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.323829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-13T18:21:00.324287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-13T18:21:00.324362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-13T18:21:00.324430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-13T18:21:00.324466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-13T18:21:00.324471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-13T18:21:00.324506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.324511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.324543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-13T18:21:00.324581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 3 size 6759613 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.324608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.324636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.324811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-13T18:21:00.326543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.326566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.326574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-13T18:21:00.326590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-13T18:21:00.326596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-13T18:21:00.326603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-13T18:21:00.326614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-13T18:21:00.326621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-13T18:21:00.326627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-13T18:21:00.326632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-13T18:21:00.326636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-13T18:21:00.326641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-13T18:21:00.326646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-13T18:21:00.326653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-13T18:21:00.326658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-13T18:21:00.326665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-13T18:21:00.326671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.326674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-13T18:21:00.327344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.327368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.327370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:21:00.327405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-13T18:21:00.327419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-13T18:21:00.327423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-13T18:21:00.327426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-13T18:21:00.327430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-13T18:21:00.327911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2253229 count 1 nextOffset 9 batches 5
2025-10-13T18:21:00.327970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-13T18:21:00.327977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-13T18:21:00.327981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-13T18:21:00.327985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-13T18:21:00.327988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-13T18:21:00.328519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 13 to 13
2025-10-13T18:21:00.329388Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660276 CreateTimestampMS: 1760379660253 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660277 CreateTimestampMS: 1760379660259 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 198 RealReadOffset: 4 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 3 }
2025-10-13T18:21:00.330506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.330525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-13T18:21:00.331490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4506426 count 2 nextOffset 10 batches 9
2025-10-13T18:21:00.331527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.331645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 8,2 HeadOffset 8 endOffset 8 curOffset 10 d0000000000_00000000000000000008_00000_0000000002_00008? size 4506416 WTime 1760379660331
2025-10-13T18:21:00.331734Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.332277Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 5
2025-10-13T18:21:00.332306Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 5 ReadGuid c39f65c7-2c97a83a-3909f3ff-a5317f2a has messages 1
2025-10-13T18:21:00.332364Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# c39f65c7-2c97a83a-3909f3ff-a5317f2a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505938
2025-10-13T18:21:00.332384Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# c39f65c7-2c97a83a-3909f3ff-a5317f2a
2025-10-13T18:21:00.334728Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 0
2025-10-13T18:21:00.335949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.336018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-13T18:21:00.336060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-13T18:21:00.336077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-13T18:21:00.336102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-13T18:21:00.336147Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.336184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.336221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.336233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.336239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.336165Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 2 size 4506416
2025-10-13T18:21:00.336383Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 5 EndOffset 5 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-10-13T18:21:00.336394Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 5 endOffset 8
2025-10-13T18:21:00.336410Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 5, endOffset# 8, WTime# 1760379660277, sizeLag# 6759613
2025-10-13T18:21:00.336413Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:21:00.338531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.338913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.340419Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 4505938, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981650
2025-10-13T18:21:00.340531Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-13T18:21:00.340557Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 4505938 to budget
2025-10-13T18:21:00.335916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 14 to 14
2025-10-13T18:21:00.340921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.340936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-13T18:21:00.342131Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-13T18:21:00.342151Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.342209Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-13T18:21:00.342226Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.342272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 15 }
2025-10-13T18:21:00.342299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 6
2025-10-13T18:21:00.342401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 11 }
2025-10-13T18:21:00.342408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 7
2025-10-13T18:21:00.342450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 1 }
2025-10-13T18:21:00.342455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 8
>>> Got event: 2025-10-13T18:21:00.342884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.342907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-13T18:21:00.253000Z WriteTime: 2025-10-13T18:21:00.276000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:45578", "logtype": "unknown", "_ip": "ipv6:[::1]:45578" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.342997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-13T18:21:00.343055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-13T18:21:00.343115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-13T18:21:00.343184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-13T18:21:00.343223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-13T18:21:00.343233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-13T18:21:00.343334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.343343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.343374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.343405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.343425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.343429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 2970331 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.343469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-13T18:21:00.343481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-13T18:21:00.343594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.344035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.344050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.344065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-13T18:21:00.344391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 2 size 4506416 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.344412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.344431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.344442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:21:00.344450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:21:00.344452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-13T18:21:00.344456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-13T18:21:00.344461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-13T18:21:00.344466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-13T18:21:00.344479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-13T18:21:00.344486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-13T18:21:00.344492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-13T18:21:00.344497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-13T18:21:00.344508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-13T18:21:00.344514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.344519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-13T18:21:00.344567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.344582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.344584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:21:00.344610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-13T18:21:00.344625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-13T18:21:00.344629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-13T18:21:00.344632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-13T18:21:00.344635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-13T18:21:00.345054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2253230 count 1 nextOffset 11 batches 5
2025-10-13T18:21:00.345079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.345186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00004? size 2253220 WTime 1760379660344
2025-10-13T18:21:00.344185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.345664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.345689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.345902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 22 }
2025-10-13T18:21:00.345913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 9
2025-10-13T18:21:00.345849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.345514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000003_00012?
2025-10-13T18:21:00.345527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000002_00008?
2025-10-13T18:21:00.345531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266029 bytes
2025-10-13T18:21:00.345558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 2253219 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:21:00.345562Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.345582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-13T18:21:00.345611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-13T18:21:00.345617Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.345630Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 2253220
2025-10-13T18:21:00.345636Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-13T18:21:00.345638Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-13T18:21:00.345641Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-13T18:21:00.345643Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000002_00008?(+) to d0000000000_00000000000000000003_00000_0000000002_00008?(+)
2025-10-13T18:21:00.345651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:21:00.345654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000003_00012?
2025-10-13T18:21:00.345663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000002_00008?
2025-10-13T18:21:00.345674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:21:00.346151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.346380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 15 to 15
2025-10-13T18:21:00.346384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.346399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.346471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-13T18:21:00.346528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-13T18:21:00.346582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-13T18:21:00.346643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-13T18:21:00.346674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-13T18:21:00.346683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-13T18:21:00.346710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.346718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.346731Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:21:00.346749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 3 parts 12 suffix '63'
2025-10-13T18:21:00.346759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:21:00.346779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.346786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.346794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.346812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.346821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.346825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.346985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-13T18:21:00.347130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-13T18:21:00.347270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-13T18:21:00.347407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-13T18:21:00.347709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-13T18:21:00.348039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.348052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-13T18:21:00.348362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-13T18:21:00.348381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-13T18:21:00.348554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-13T18:21:00.348700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-13T18:21:00.348846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-13T18:21:00.349046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-13T18:21:00.349153Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.349203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 3 }
2025-10-13T18:21:00.349215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 10
2025-10-13T18:21:00.349660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-13T18:21:00.349681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-13T18:21:00.349822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-13T18:21:00.352378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-13T18:21:00.352519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-13T18:21:00.352674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-13T18:21:00.352706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 16 to 16
2025-10-13T18:21:00.352749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-13T18:21:00.352771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760379660352
2025-10-13T18:21:00.353078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-13T18:21:00.353097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.353225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-13T18:21:00.353371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-13T18:21:00.353501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-13T18:21:00.353633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-13T18:21:00.353816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-13T18:21:00.354228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.354243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-13T18:21:00.354558Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (4-4)
2025-10-13T18:21:00.354578Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.354587Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505938, ReadSizeServerDelta = -3981650
2025-10-13T18:21:00.354720Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.354734Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-13T18:21:00.259000Z WriteTime: 2025-10-13T18:21:00.277000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:45578", "_ip": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.354398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-13T18:21:00.354415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-13T18:21:00.354553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-13T18:21:00.354683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-13T18:21:00.354827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-13T18:21:00.354878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-13T18:21:00.355509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-13T18:21:00.355596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 3 endOffset 5 curOffset 10 d0000000000_00000000000000000007_00001_0000000003_00011| size 6247582 WTime 1760379660355
2025-10-13T18:21:00.356098Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505938 } }
2025-10-13T18:21:00.356171Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# 68bdaaf8-7d97a8c5-a55b329d-ca04a112
2025-10-13T18:21:00.356196Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# b1e7a863-20fa3d12-f582f08a-219b037, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.356245Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 5 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid b1e7a863-20fa3d12-f582f08a-219b037
2025-10-13T18:21:00.357079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.357095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.357114Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.357126Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-13T18:21:00.357138Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 6247582
2025-10-13T18:21:00.357157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-13T18:21:00.357270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.357453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 5 count 3 size 524288 endOffset 10 max time lag 0ms effective offset 5
2025-10-13T18:21:00.357483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 6759613 count 3 last offset 5, current partition end offset: 10
2025-10-13T18:21:00.357489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-13T18:21:00.357503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 1 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.357508Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-13T18:21:00.357526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 3 parts 12 suffix '63'
2025-10-13T18:21:00.357530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.357795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.359185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.358011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.358205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.358348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.359034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-13T18:21:00.359442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.359599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.359862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 17 to 17
2025-10-13T18:21:00.361634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.361649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-13T18:21:00.361701Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.360019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.360159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.360343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-13T18:21:00.360490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.360626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.360757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.360823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:21:00.362761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.362773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.362959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-13T18:21:00.363022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-13T18:21:00.363075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-13T18:21:00.363130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-13T18:21:00.363164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-13T18:21:00.363168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-13T18:21:00.363199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.363206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.363237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 5
2025-10-13T18:21:00.363283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.363288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.363292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 2 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.363299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 2253220 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.363329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.363353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.363355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:21:00.363371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:21:00.363377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:21:00.363385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:21:00.366996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 18 to 18
2025-10-13T18:21:00.368836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.368854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-13T18:21:00.368922Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.369166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.369199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.369210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.369223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-13T18:21:00.369231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.369235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-13T18:21:00.369237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.369241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-13T18:21:00.369243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.369250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-13T18:21:00.369257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.369263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-13T18:21:00.369317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.369333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.369336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:21:00.369364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-13T18:21:00.369376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-13T18:21:00.369379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-13T18:21:00.369383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-13T18:21:00.369386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-13T18:21:00.369792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2253230 count 1 nextOffset 12 batches 5
2025-10-13T18:21:00.369813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-13T18:21:00.369818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-13T18:21:00.369822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-13T18:21:00.369825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-13T18:21:00.369829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-13T18:21:00.370501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4506428 count 2 nextOffset 13 batches 9
2025-10-13T18:21:00.370519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.370633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,2 HeadOffset 11 endOffset 11 curOffset 13 d0000000000_00000000000000000011_00000_0000000002_00008? size 4506418 WTime 1760379660370
2025-10-13T18:21:00.371288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.371320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-13T18:21:00.371372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-13T18:21:00.371381Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.371394Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 2 size 4506418
2025-10-13T18:21:00.374432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.374468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.376403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.378226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 19 to 19
2025-10-13T18:21:00.376997Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 10 Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660299 CreateTimestampMS: 1760379660266 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660299 CreateTimestampMS: 1760379660272 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660300 CreateTimestampMS: 1760379660280 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 6759899 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 10 StartOffset: 0 } Cookie: 5 }
2025-10-13T18:21:00.380153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.380620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.380638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-13T18:21:00.380707Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.380764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 1 }
2025-10-13T18:21:00.380774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 11
2025-10-13T18:21:00.380944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.380966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.381055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-13T18:21:00.381119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-13T18:21:00.381178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-13T18:21:00.381237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-13T18:21:00.381279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-13T18:21:00.381291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-13T18:21:00.381414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.381423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.381438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.381465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.381487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.381494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6247582 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.381535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.381563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:21:00.381579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-13T18:21:00.381583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-13T18:21:00.382495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.382514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.382531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-13T18:21:00.382554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.382558Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.381623Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 10
2025-10-13T18:21:00.381654Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 10 ReadOffset 8 ReadGuid b1e7a863-20fa3d12-f582f08a-219b037 has messages 1
2025-10-13T18:21:00.381704Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 10, WTime# 1760379660300, sizeLag# 6759899
2025-10-13T18:21:00.381708Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:21:00.381723Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# b1e7a863-20fa3d12-f582f08a-219b037, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758781
2025-10-13T18:21:00.381733Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# b1e7a863-20fa3d12-f582f08a-219b037
2025-10-13T18:21:00.382795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.384540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 20 to 20
2025-10-13T18:21:00.384639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.384879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.384895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-13T18:21:00.384958Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.385630Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 1
2025-10-13T18:21:00.385901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.385929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.386296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.386526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-13T18:21:00.386606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.386605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-13T18:21:00.386682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-13T18:21:00.387201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-13T18:21:00.387256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-13T18:21:00.387276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-13T18:21:00.387317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.387514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.387322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.387333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.387360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.387378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-13T18:21:00.389040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 21 to 21
2025-10-13T18:21:00.389539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.389560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-13T18:21:00.389572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.389637Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.389735Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 6758781, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234493
2025-10-13T18:21:00.389832Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-13T18:21:00.389862Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 6758781 to budget
2025-10-13T18:21:00.390130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.390441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.391672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.391696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.391824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-13T18:21:00.391975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-13T18:21:00.392100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-13T18:21:00.392165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-13T18:21:00.392295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-13T18:21:00.392300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-13T18:21:00.392333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.392338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.392350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.392375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.392466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 2 size 4506418 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.392490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-13T18:21:00.392503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.392520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.392528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-13T18:21:00.392533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:21:00.392536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-13T18:21:00.392542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-13T18:21:00.392548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-13T18:21:00.392556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-13T18:21:00.392568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-13T18:21:00.392574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-13T18:21:00.392579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-13T18:21:00.392587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-13T18:21:00.392593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-13T18:21:00.392599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.392603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-13T18:21:00.392645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.392661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.392663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-13T18:21:00.392689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-13T18:21:00.392700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-13T18:21:00.392703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-13T18:21:00.392706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-13T18:21:00.392709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-13T18:21:00.393619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-13T18:21:00.393654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-13T18:21:00.393660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-13T18:21:00.393664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-13T18:21:00.393667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-13T18:21:00.393671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-13T18:21:00.392801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.394370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 4506428 count 2 nextOffset 15 batches 9
2025-10-13T18:21:00.394395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-13T18:21:00.394400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-13T18:21:00.394404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-13T18:21:00.394408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-13T18:21:00.394411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-13T18:21:00.394445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.394882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.394947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 6759626 count 3 nextOffset 16 batches 13
2025-10-13T18:21:00.394968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.396104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.396134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.396755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 22 }
2025-10-13T18:21:00.396778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 12
2025-10-13T18:21:00.396784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.397163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 22 to 22
2025-10-13T18:21:00.395084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 13,3 HeadOffset 13 endOffset 13 curOffset 16 d0000000000_00000000000000000013_00000_0000000003_00012? size 6759616 WTime 1760379660394
2025-10-13T18:21:00.395904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.395972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 2970331 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.395977Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.395998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-13T18:21:00.396030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-13T18:21:00.396663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.396670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.396746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-13T18:21:00.396799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-13T18:21:00.396854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-13T18:21:00.396911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-13T18:21:00.396940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-13T18:21:00.396946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-13T18:21:00.396973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.396976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.396986Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.397004Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 3 size 6759616
2025-10-13T18:21:00.397012Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000003_00012?(+) to d0000000000_00000000000000000005_00000_0000000003_00012?(+)
2025-10-13T18:21:00.397015Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000002_00008?(+) to d0000000000_00000000000000000008_00000_0000000002_00008?(+)
2025-10-13T18:21:00.397018Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000002_00005|(+) to d0000000000_00000000000000000003_00003_0000000002_00005|(+)
2025-10-13T18:21:00.397027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.397046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.397250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.397114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-13T18:21:00.397528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.397540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-13T18:21:00.398047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.398338Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (5-5)
2025-10-13T18:21:00.398357Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.398424Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-13T18:21:00.398440Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.398698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.398986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.399028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 6 }
2025-10-13T18:21:00.399039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 13
2025-10-13T18:21:00.399044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-13T18:21:00.266000Z WriteTime: 2025-10-13T18:21:00.299000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.399583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.399598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.399671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-13T18:21:00.399723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-13T18:21:00.399804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-13T18:21:00.399862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-13T18:21:00.399983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-13T18:21:00.399995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-13T18:21:00.400024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.400033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.400044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.400064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.400077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-13T18:21:00.400221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.401713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.402034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.402270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.402286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.402725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 23 to 23
2025-10-13T18:21:00.402721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-13T18:21:00.403149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-13T18:21:00.403581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-13T18:21:00.403639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-13T18:21:00.403682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-13T18:21:00.403689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-13T18:21:00.403718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.403730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.403743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.403772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.403794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-13T18:21:00.404488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.404586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.404603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-13T18:21:00.404613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.404665Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.406114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.406424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.407138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.407162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.407250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-13T18:21:00.407333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-13T18:21:00.407438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-13T18:21:00.407515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-13T18:21:00.407571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-13T18:21:00.407583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-13T18:21:00.407611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.407622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.408141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.407709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.407743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.407792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 5 count 3 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.407797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 8 count 2 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.407807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 3 size 6759616 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.407830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-13T18:21:00.407840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.407862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.407869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-13T18:21:00.407884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-13T18:21:00.407892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-13T18:21:00.407899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-13T18:21:00.407911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-13T18:21:00.407943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-13T18:21:00.407950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-13T18:21:00.407957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-13T18:21:00.407963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-13T18:21:00.407971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-13T18:21:00.407977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-13T18:21:00.407983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-13T18:21:00.407988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-13T18:21:00.407994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.407997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-13T18:21:00.407999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.408003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-13T18:21:00.408047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.408066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.408069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-13T18:21:00.408091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-13T18:21:00.408096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-13T18:21:00.408105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:21:00.408108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-13T18:21:00.408111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-13T18:21:00.408115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:21:00.408115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-13T18:21:00.408118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-13T18:21:00.408509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-13T18:21:00.408543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-13T18:21:00.408550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-13T18:21:00.408555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-13T18:21:00.408559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-13T18:21:00.408563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-13T18:21:00.409043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4506428 count 2 nextOffset 18 batches 9
2025-10-13T18:21:00.409069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-13T18:21:00.409075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-13T18:21:00.409078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-13T18:21:00.409081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-13T18:21:00.409084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-13T18:21:00.409764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 6759626 count 3 nextOffset 19 batches 13
2025-10-13T18:21:00.409787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-13T18:21:00.409792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-13T18:21:00.409798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-13T18:21:00.409802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-13T18:21:00.409692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.410046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.417431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 20 partNo 3 result is x0000000000_00000000000000000016_00000_0000000003_00015? size 8295638
2025-10-13T18:21:00.417467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-13T18:21:00.417489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000016_00000_0000000003_00015? new key d0000000000_00000000000000000016_00000_0000000003_00015? size 8295638 WTime 1760379660417
2025-10-13T18:21:00.417621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 1 NewHead: Offset 19 PartNo 3 PackedSize 717145 count 1 nextOffset 20 batches 2
2025-10-13T18:21:00.417636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.417750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 19,1 HeadOffset 16 endOffset 16 curOffset 20 d0000000000_00000000000000000019_00003_0000000001_00001? size 717135 WTime 1760379660417
2025-10-13T18:21:00.417885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000001_00004?
2025-10-13T18:21:00.417896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000002_00008?
2025-10-13T18:21:00.417899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000003_00012?
2025-10-13T18:21:00.417903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 13519254 bytes
2025-10-13T18:21:00.417980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-13T18:21:00.418021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-13T18:21:00.418040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-13T18:21:00.418550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.418589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.418602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.419006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 11 }
2025-10-13T18:21:00.419022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 14
2025-10-13T18:21:00.419029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.419016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.419039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.419108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 7 }
2025-10-13T18:21:00.419113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 15
2025-10-13T18:21:00.419138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 2 }
2025-10-13T18:21:00.419151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 16
2025-10-13T18:21:00.419531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 24 to 24
2025-10-13T18:21:00.419874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.419890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-13T18:21:00.419117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-13T18:21:00.419184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-13T18:21:00.419239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-13T18:21:00.419303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-13T18:21:00.419338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-13T18:21:00.419344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-13T18:21:00.419379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.419383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.419393Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.419409Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 3 size 8295638
2025-10-13T18:21:00.419417Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 3 count 1 size 717135
2025-10-13T18:21:00.419432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-13T18:21:00.419435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000001_00004?
2025-10-13T18:21:00.419445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000002_00008?
2025-10-13T18:21:00.419455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000003_00012?
2025-10-13T18:21:00.419471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-13T18:21:00.419509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.419532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.419594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.419597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.419601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.419617Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-13T18:21:00.419650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.419652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-13T18:21:00.419654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:21:00.419657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 12 suffix '63'
2025-10-13T18:21:00.419683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.419688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.419818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-13T18:21:00.419974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-13T18:21:00.420112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-13T18:21:00.420264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-13T18:21:00.420445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-13T18:21:00.421431Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (6-6)
2025-10-13T18:21:00.421455Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.419746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-13T18:21:00.272000Z WriteTime: 2025-10-13T18:21:00.299000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.424077Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-13T18:21:00.424095Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.421882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.422200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.423791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295579
2025-10-13T18:21:00.423815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295579 WTime 1760379660423
2025-10-13T18:21:00.423835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-13T18:21:00.423851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.423986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-13T18:21:00.424115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-13T18:21:00.424264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-13T18:21:00.424405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-13T18:21:00.424592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-13T18:21:00.425094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-13T18:21:00.425104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-13T18:21:00.425236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-13T18:21:00.425361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-13T18:21:00.425493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-13T18:21:00.425550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-13T18:21:00.427544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 25 to 25
2025-10-13T18:21:00.427816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.427834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-13T18:21:00.426201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-13T18:21:00.426215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.426343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-13T18:21:00.426470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-13T18:21:00.426597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-13T18:21:00.426723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-13T18:21:00.426901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-13T18:21:00.427355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 6964712 count 4 nextOffset 14 batches 13
2025-10-13T18:21:00.427363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-13T18:21:00.427488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-13T18:21:00.427838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-13T18:21:00.428939Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.434130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 26 to 26
2025-10-13T18:21:00.434408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.434420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-13T18:21:00.434429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.434643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988738
2025-10-13T18:21:00.434747Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (7-7)
2025-10-13T18:21:00.434766Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.434776Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758781, ReadSizeServerDelta = -6234493
2025-10-13T18:21:00.434908Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.434919Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-13T18:21:00.280000Z WriteTime: 2025-10-13T18:21:00.300000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:45578", "logtype": "unknown", "server": "ipv6:[::1]:45578", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.434790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-13T18:21:00.435018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-13T18:21:00.435034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988738 WTime 1760379660434
2025-10-13T18:21:00.435255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-13T18:21:00.435269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-13T18:21:00.435407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-13T18:21:00.435547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-13T18:21:00.435682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-13T18:21:00.435745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-13T18:21:00.436414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-13T18:21:00.436515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,2 HeadOffset 7 endOffset 10 curOffset 16 d0000000000_00000000000000000014_00002_0000000002_00006| size 3482360 WTime 1760379660435
2025-10-13T18:21:00.437635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.437651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.437726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-13T18:21:00.437780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-13T18:21:00.437840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-13T18:21:00.437902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-13T18:21:00.436256Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758781 } }
2025-10-13T18:21:00.436339Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# 76a8a22c-13588938-85738556-b9d412ab
2025-10-13T18:21:00.436361Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 58c2057d-b02176c5-5a1dd86b-f4305c77, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.436392Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 10 ClientCommitOffset 0 committedOffset 0 Guid 58c2057d-b02176c5-5a1dd86b-f4305c77
2025-10-13T18:21:00.437925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-13T18:21:00.437930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-13T18:21:00.437962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.437965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.438023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.438025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.438039Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.438052Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295579
2025-10-13T18:21:00.438059Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988738
2025-10-13T18:21:00.438066Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 2 size 3482360
2025-10-13T18:21:00.438079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.438105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.438112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-13T18:21:00.438364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 2 size 524288 endOffset 16 max time lag 0ms effective offset 8
2025-10-13T18:21:00.438372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 0 blobs, size 0 count 0 last offset 8, current partition end offset: 16
2025-10-13T18:21:00.438741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. All data is from uncompacted head.
2025-10-13T18:21:00.438749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-13T18:21:00.438798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-13T18:21:00.439199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-13T18:21:00.439203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.439222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 1 size 26214400 endOffset 16 max time lag 0ms effective offset 8
2025-10-13T18:21:00.439226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 0 blobs, size 0 count 0 last offset 8, current partition end offset: 16
2025-10-13T18:21:00.439535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. All data is from uncompacted head.
2025-10-13T18:21:00.439541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-13T18:21:00.439568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 8
2025-10-13T18:21:00.440024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 3 size 8295638 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.440028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 19 count 1 size 717135 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.440045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.440061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.440067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:21:00.440076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-13T18:21:00.440080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.440081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:21:00.440087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-13T18:21:00.440088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-13T18:21:00.440095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-13T18:21:00.440105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-13T18:21:00.440111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-13T18:21:00.440116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-13T18:21:00.440121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-13T18:21:00.440126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-13T18:21:00.440133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-13T18:21:00.440140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-13T18:21:00.440145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-13T18:21:00.440149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-13T18:21:00.440154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-13T18:21:00.440160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-13T18:21:00.440166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-13T18:21:00.440173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-13T18:21:00.440179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-13T18:21:00.440186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-13T18:21:00.440192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.440195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-13T18:21:00.440224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.440237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.440240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:21:00.440262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-13T18:21:00.440271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-13T18:21:00.440275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-13T18:21:00.440278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-13T18:21:00.440281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-13T18:21:00.440729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-13T18:21:00.440747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-13T18:21:00.440753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-13T18:21:00.440756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-13T18:21:00.440759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-13T18:21:00.440764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-13T18:21:00.441235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 4506428 count 2 nextOffset 22 batches 9
2025-10-13T18:21:00.441245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.441347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,2 HeadOffset 20 endOffset 20 curOffset 22 d0000000000_00000000000000000020_00000_0000000002_00008? size 4506418 WTime 1760379660440
2025-10-13T18:21:00.443086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.443120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.443124Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.443142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-13T18:21:00.443940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 10 }
2025-10-13T18:21:00.443959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 17
2025-10-13T18:21:00.443965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.443568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.444458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 27 to 27
2025-10-13T18:21:00.444713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.444726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-13T18:21:00.444734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.444798Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.444770Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 16 Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660327 CreateTimestampMS: 1760379660290 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 8807773 RealReadOffset: 8 WaitQuotaTimeMs: 0 EndOffset: 16 StartOffset: 0 } Cookie: 8 }
2025-10-13T18:21:00.445043Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 9 endOffset 16
2025-10-13T18:21:00.445062Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 16 ReadOffset 9 ReadGuid 58c2057d-b02176c5-5a1dd86b-f4305c77 has messages 1
2025-10-13T18:21:00.445088Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 9, endOffset# 16, WTime# 1760379660327, sizeLag# 8807773
2025-10-13T18:21:00.445093Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:21:00.445106Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# 58c2057d-b02176c5-5a1dd86b-f4305c77, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-13T18:21:00.445116Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# 58c2057d-b02176c5-5a1dd86b-f4305c77
2025-10-13T18:21:00.446181Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 1
2025-10-13T18:21:00.446397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-13T18:21:00.446423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-13T18:21:00.446438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-13T18:21:00.446446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-13T18:21:00.446452Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.446470Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 2 size 4506418
2025-10-13T18:21:00.446886Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-13T18:21:00.446983Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-13T18:21:00.446999Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 2252978 to budget
2025-10-13T18:21:00.446831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.446855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.446861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.446868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.448028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 8 }
2025-10-13T18:21:00.448041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 18
2025-10-13T18:21:00.448047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.448526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 5 }
2025-10-13T18:21:00.448536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 19
2025-10-13T18:21:00.449069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 28 to 28
2025-10-13T18:21:00.448656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.449066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.449425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.449441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-13T18:21:00.449702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 2 }
2025-10-13T18:21:00.449712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 20
2025-10-13T18:21:00.449879Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-10-13T18:21:00.449901Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.449912Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-13T18:21:00.450000Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.450013Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.450099Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-13T18:21:00.450160Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# e3b879e7-6ae2aad3-9900e5ae-5fe3bcfa
2025-10-13T18:21:00.450177Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# bbdb0275-77e52241-92ea4096-cd18630b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.450205Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 9 EndOffset 16 ClientCommitOffset 0 committedOffset 0 Guid bbdb0275-77e52241-92ea4096-cd18630b
2025-10-13T18:21:00.450823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-13T18:21:00.290000Z WriteTime: 2025-10-13T18:21:00.327000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:45578", "_ip": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.450035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.450059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.450202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-13T18:21:00.450301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-13T18:21:00.450426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-13T18:21:00.450498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-13T18:21:00.450536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-13T18:21:00.450541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-13T18:21:00.450570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.450574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.450607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.450609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.450624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.450653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.450677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-13T18:21:00.450714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 9 count 8 size 524288 endOffset 20 max time lag 0ms effective offset 9
2025-10-13T18:21:00.450720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 0 blobs, size 0 count 0 last offset 9, current partition end offset: 20
2025-10-13T18:21:00.451110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. All data is from uncompacted head.
2025-10-13T18:21:00.451120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-13T18:21:00.451166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 9
2025-10-13T18:21:00.451719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-13T18:21:00.451725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.451750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 9 count 1 size 26214400 endOffset 20 max time lag 0ms effective offset 9
2025-10-13T18:21:00.451754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 0 blobs, size 0 count 0 last offset 9, current partition end offset: 20
2025-10-13T18:21:00.451794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. All data is from uncompacted head.
2025-10-13T18:21:00.451798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-13T18:21:00.451819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 9
2025-10-13T18:21:00.453207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.453486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.454348Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 20 Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760379660327 CreateTimestampMS: 1760379660298 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 0 SizeLag: 23863027 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 20 StartOffset: 0 } Cookie: 9 }
2025-10-13T18:21:00.454570Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 20
2025-10-13T18:21:00.454581Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 20 ReadOffset 10 ReadGuid bbdb0275-77e52241-92ea4096-cd18630b has messages 1
2025-10-13T18:21:00.454604Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 20, WTime# 1760379660327, sizeLag# 23863027
2025-10-13T18:21:00.454607Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:21:00.454620Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# bbdb0275-77e52241-92ea4096-cd18630b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-13T18:21:00.454633Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# bbdb0275-77e52241-92ea4096-cd18630b
2025-10-13T18:21:00.455855Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 1
2025-10-13T18:21:00.456493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 29 to 29
2025-10-13T18:21:00.456528Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-13T18:21:00.456632Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-13T18:21:00.456650Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 2252978 to budget
2025-10-13T18:21:00.456777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.456793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-13T18:21:00.456850Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.457494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.457518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.457600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-13T18:21:00.457664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-13T18:21:00.457720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-13T18:21:00.457772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-13T18:21:00.457804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-13T18:21:00.457809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-13T18:21:00.457837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.457840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.457879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.457904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.457920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-13T18:21:00.458599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.460941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 30 to 30
2025-10-13T18:21:00.461342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.461356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-13T18:21:00.461366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.461395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.461541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.461566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.461688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.461715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-13T18:21:00.461777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-13T18:21:00.462106Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (9-9)
2025-10-13T18:21:00.462124Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:21:00.462136Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-13T18:21:00.461864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-13T18:21:00.462001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-13T18:21:00.462037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-13T18:21:00.462041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-13T18:21:00.462065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.462087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.462227Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.462238Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.462345Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-13T18:21:00.462419Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# 8d7cd0a4-3444d019-d3df8d2e-7319a916
2025-10-13T18:21:00.462445Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 18872beb-6c7757e6-ac768cff-5b340f10, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.462472Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 20 ClientCommitOffset 0 committedOffset 0 Guid 18872beb-6c7757e6-ac768cff-5b340f10
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-13T18:21:00.298000Z WriteTime: 2025-10-13T18:21:00.327000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.467851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.467872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.468062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.467930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.467938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.467958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-13T18:21:00.468207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 12 size 524288 endOffset 20 max time lag 0ms effective offset 10
2025-10-13T18:21:00.468235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 1 blobs, size 2253220 count 1 last offset 10, current partition end offset: 20
2025-10-13T18:21:00.468238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-13T18:21:00.468252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 1 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.468263Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 1 blobs are from cache.
2025-10-13T18:21:00.468282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:21:00.468292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.468446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.468617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.468748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.468884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.468952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 1 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:21:00.468992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-13T18:21:00.470727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.471047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.473172Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 20 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660344 CreateTimestampMS: 1760379660312 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 21815002 RealReadOffset: 10 WaitQuotaTimeMs: 0 EndOffset: 20 StartOffset: 0 } Cookie: 10 }
2025-10-13T18:21:00.472244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.472264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.472340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-13T18:21:00.472393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-13T18:21:00.472503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-13T18:21:00.472625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-13T18:21:00.472659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-13T18:21:00.472663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-13T18:21:00.472764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.472769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.472801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.472827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.472841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.472845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.472850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 2 size 3482360 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.473027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.473323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-13T18:21:00.473330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-13T18:21:00.473337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:21:00.473341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:21:00.473344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:21:00.473348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-10-13T18:21:00.473558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.473563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000003_00015?
2025-10-13T18:21:00.473569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00003_0000000001_00001?
2025-10-13T18:21:00.473573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-13T18:21:00.473588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-13T18:21:00.473617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6247582 cause it's been evicted from L2. Actual L1 size: 8
2025-10-13T18:21:00.473621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 13 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:21:00.473623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 11 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.473628Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.473648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:21:00.473652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000003_00015?
2025-10-13T18:21:00.473664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000019_00003_0000000001_00001?
2025-10-13T18:21:00.474007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:21:00.474054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.474063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 19 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.474072Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:21:00.474096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.474106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.474202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:21:00.474215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 19 partno 3 count 1 parts 1 suffix '63'
2025-10-13T18:21:00.474242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-13T18:21:00.474549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-13T18:21:00.474691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-13T18:21:00.474859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-13T18:21:00.475055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-13T18:21:00.475545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-13T18:21:00.475575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-13T18:21:00.475769Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 2252979, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728691
2025-10-13T18:21:00.475723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-13T18:21:00.475894Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-13T18:21:00.475912Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 2252979 to budget
2025-10-13T18:21:00.475883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-13T18:21:00.473493Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 11 endOffset 20
2025-10-13T18:21:00.473519Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 20 ReadOffset 11 ReadGuid 18872beb-6c7757e6-ac768cff-5b340f10 has messages 1
2025-10-13T18:21:00.473551Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 11, endOffset# 20, WTime# 1760379660344, sizeLag# 21815002
2025-10-13T18:21:00.473554Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:21:00.473570Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# 18872beb-6c7757e6-ac768cff-5b340f10, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252979
2025-10-13T18:21:00.473581Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# 18872beb-6c7757e6-ac768cff-5b340f10
2025-10-13T18:21:00.474815Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 1
2025-10-13T18:21:00.474859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.476859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.477180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.476043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-13T18:21:00.476234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-13T18:21:00.477137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 4506428 count 2 nextOffset 18 batches 9
2025-10-13T18:21:00.477149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-13T18:21:00.479785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988778
2025-10-13T18:21:00.479934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-13T18:21:00.480079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-13T18:21:00.480212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-13T18:21:00.480297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-13T18:21:00.480313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988778 WTime 1760379660479
2025-10-13T18:21:00.480710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-13T18:21:00.481163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-13T18:21:00.481168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-13T18:21:00.481171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-13T18:21:00.481182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.481294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-13T18:21:00.481361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-13T18:21:00.481802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-13T18:21:00.481914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,2 HeadOffset 14 endOffset 16 curOffset 20 d0000000000_00000000000000000018_00000_0000000002_00008| size 4506418 WTime 1760379660481
2025-10-13T18:21:00.484596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.484615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.484700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-13T18:21:00.484768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-13T18:21:00.484826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-13T18:21:00.484880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-13T18:21:00.484912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-13T18:21:00.484921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-13T18:21:00.484956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.484964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.484977Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.484991Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988778
2025-10-13T18:21:00.485005Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 2 size 4506418
2025-10-13T18:21:00.485035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 2 size 4506418 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.485062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.485083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:21:00.485088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.485089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:21:00.485142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.485146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.485165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.485171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-13T18:21:00.485182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-13T18:21:00.485187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-13T18:21:00.485193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-13T18:21:00.485203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-13T18:21:00.485210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-13T18:21:00.485217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-13T18:21:00.485222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-13T18:21:00.485228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-13T18:21:00.485234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.485240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-13T18:21:00.485273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.485290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.485292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-13T18:21:00.485313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-13T18:21:00.485322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-13T18:21:00.485326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-13T18:21:00.485330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-13T18:21:00.485334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-13T18:21:00.485707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-13T18:21:00.485723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-13T18:21:00.485729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-13T18:21:00.485732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-13T18:21:00.485736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-13T18:21:00.485739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-13T18:21:00.486215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-13T18:21:00.486229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-13T18:21:00.486235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-13T18:21:00.486238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-13T18:21:00.486240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-13T18:21:00.486244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-13T18:21:00.486730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-13T18:21:00.486743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-13T18:21:00.486749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-13T18:21:00.486752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-13T18:21:00.486755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-13T18:21:00.494335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 26 partNo 3 result is x0000000000_00000000000000000022_00000_0000000003_00015? size 8295638
2025-10-13T18:21:00.494364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-13T18:21:00.494384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000022_00000_0000000003_00015? new key d0000000000_00000000000000000022_00000_0000000003_00015? size 8295638 WTime 1760379660494
2025-10-13T18:21:00.494501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 3 PackedSize 717145 count 1 nextOffset 26 batches 2
2025-10-13T18:21:00.494520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-13T18:21:00.494532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-13T18:21:00.494535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-13T18:21:00.494539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-13T18:21:00.494544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-13T18:21:00.495103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 3 PackedSize 2970343 count 2 nextOffset 27 batches 6
2025-10-13T18:21:00.495126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.495225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 22 endOffset 22 curOffset 27 d0000000000_00000000000000000025_00003_0000000002_00005? size 2970333 WTime 1760379660494
2025-10-13T18:21:00.495572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.495617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 2253220 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.495628Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.495654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-13T18:21:00.495729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-13T18:21:00.495749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-13T18:21:00.495755Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.495766Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 3 size 8295638
2025-10-13T18:21:00.495772Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 3 count 2 size 2970333
2025-10-13T18:21:00.495788Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000001_00004?(+) to d0000000000_00000000000000000010_00000_0000000001_00004?(+)
2025-10-13T18:21:00.495790Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000002_00008?(+) to d0000000000_00000000000000000011_00000_0000000002_00008?(+)
2025-10-13T18:21:00.495791Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000003_00012?(+) to d0000000000_00000000000000000013_00000_0000000003_00012?(+)
2025-10-13T18:21:00.495795Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000003_00011|(+) to d0000000000_00000000000000000007_00001_0000000003_00011|(+)
2025-10-13T18:21:00.495884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.495931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.495943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.497664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.497986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.498182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.498200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.498271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-13T18:21:00.498322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-13T18:21:00.498377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-13T18:21:00.498434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-13T18:21:00.498474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-13T18:21:00.498483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-13T18:21:00.498508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.498515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.498527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.498553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.498569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-13T18:21:00.498661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.500048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 20 }
2025-10-13T18:21:00.500066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 21
2025-10-13T18:21:00.500072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.500054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.500157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 44 queued_in_partition_duration_ms: 2 }
2025-10-13T18:21:00.500162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 22
2025-10-13T18:21:00.500305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.500443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 31 to 31
2025-10-13T18:21:00.500899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.500919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.500985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-13T18:21:00.501040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-13T18:21:00.501101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-13T18:21:00.501157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-13T18:21:00.501197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-13T18:21:00.501206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-13T18:21:00.501231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.501238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.501249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.501272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.501292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-13T18:21:00.501322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.501336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-13T18:21:00.501377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.502466Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.503572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.503589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.503661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-13T18:21:00.503696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.503737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-13T18:21:00.503794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-13T18:21:00.503852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-13T18:21:00.503896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-13T18:21:00.503905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-13T18:21:00.503943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.503970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.504024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.504245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.504258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.504283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-13T18:21:00.504523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.506593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 32 to 32
2025-10-13T18:21:00.506718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.506730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.506799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-13T18:21:00.506844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.506856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-13T18:21:00.506847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-13T18:21:00.506901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-13T18:21:00.506956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-13T18:21:00.506997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-13T18:21:00.507001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-13T18:21:00.507022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.507042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.507430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.507443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 2 size 4506418 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.507460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.507494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-13T18:21:00.507504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:21:00.507509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:21:00.507513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-13T18:21:00.507893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.508169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.508186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.508210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:21:00.508219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.508223Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.508234Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-13T18:21:00.508255Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:21:00.508268Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252979, ReadSizeServerDelta = -1728691
2025-10-13T18:21:00.508370Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.508384Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.509636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.509985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.510248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.510263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.510306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-13T18:21:00.510428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-13T18:21:00.312000Z WriteTime: 2025-10-13T18:21:00.344000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:45578", "_ip": "ipv6:[::1]:45578", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.512121Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252979 } }
2025-10-13T18:21:00.512179Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# 5e6c1c8e-7dc301ad-fe7defb5-181eede9
2025-10-13T18:21:00.512205Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 2e4b395c-ee978ba3-a8242967-d2161af, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.512223Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 11 EndOffset 20 ClientCommitOffset 0 committedOffset 0 Guid 2e4b395c-ee978ba3-a8242967-d2161af
2025-10-13T18:21:00.512770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.512789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.512849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-13T18:21:00.512901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-13T18:21:00.512947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-13T18:21:00.512999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-13T18:21:00.513042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-13T18:21:00.513052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-13T18:21:00.513072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.513099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.513282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.513306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.513373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 11 count 10 size 524288 endOffset 22 max time lag 0ms effective offset 11
2025-10-13T18:21:00.513422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 2 blobs, size 7988778 count 7 last offset 14, current partition end offset: 22
2025-10-13T18:21:00.513842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-13T18:21:00.513878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.513884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 2 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.513898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 14. Have to read 1 of 2 from KV
2025-10-13T18:21:00.513946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0'
2025-10-13T18:21:00.513959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-13T18:21:00.526429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 3 size 8295638 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.526444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 2970333 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.526471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.526491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.526498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-13T18:21:00.526516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-13T18:21:00.526523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-13T18:21:00.526530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-13T18:21:00.526542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-13T18:21:00.526549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-13T18:21:00.526557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-13T18:21:00.526563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-13T18:21:00.526568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-13T18:21:00.526573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-13T18:21:00.526579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-13T18:21:00.526584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-13T18:21:00.526589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-13T18:21:00.526595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-13T18:21:00.526601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-13T18:21:00.526606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-13T18:21:00.526613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-13T18:21:00.526618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-13T18:21:00.526624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-13T18:21:00.526630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-13T18:21:00.526637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-13T18:21:00.526641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-13T18:21:00.526647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-13T18:21:00.526651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-13T18:21:00.526675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.526678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-13T18:21:00.526728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.526755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.526757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-13T18:21:00.526786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-13T18:21:00.526799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-13T18:21:00.526803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-13T18:21:00.526806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-13T18:21:00.526809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-13T18:21:00.527069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-10-13T18:21:00.527075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.527079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.527083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:21:00.527219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-13T18:21:00.527244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-13T18:21:00.527255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-13T18:21:00.527258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-13T18:21:00.527261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-13T18:21:00.527265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-13T18:21:00.527743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-10-13T18:21:00.527765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-13T18:21:00.527770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-13T18:21:00.527774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-13T18:21:00.527777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-13T18:21:00.527781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-13T18:21:00.528273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 6759626 count 3 nextOffset 30 batches 13
2025-10-13T18:21:00.528295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-13T18:21:00.528300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-13T18:21:00.528304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-13T18:21:00.528307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-13T18:21:00.529481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 31 partNo 3 result is x0000000000_00000000000000000027_00000_0000000003_00015? size 8295638
2025-10-13T18:21:00.529503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-13T18:21:00.529517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000027_00000_0000000003_00015? new key d0000000000_00000000000000000027_00000_0000000003_00015? size 8295638 WTime 1760379660529
2025-10-13T18:21:00.530358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 1 NewHead: Offset 30 PartNo 3 PackedSize 717145 count 1 nextOffset 31 batches 2
2025-10-13T18:21:00.533145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.533190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.533197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.533203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.533211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.533589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 41 queued_in_partition_duration_ms: 34 }
2025-10-13T18:21:00.533603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 23
2025-10-13T18:21:00.533609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.533949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 33 to 33
2025-10-13T18:21:00.534231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.534243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-13T18:21:00.535283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.535333Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.530429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-13T18:21:00.530439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-13T18:21:00.530444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-13T18:21:00.530447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-13T18:21:00.530450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-13T18:21:00.530893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 2970343 count 2 nextOffset 32 batches 6
2025-10-13T18:21:00.530920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.531324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,2 HeadOffset 27 endOffset 27 curOffset 32 d0000000000_00000000000000000030_00003_0000000002_00005? size 2970333 WTime 1760379660531
2025-10-13T18:21:00.532114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000002_00008?
2025-10-13T18:21:00.532119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000003_00015?
2025-10-13T18:21:00.532121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00003_0000000002_00005?
2025-10-13T18:21:00.532124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 15772389 bytes
2025-10-13T18:21:00.532181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-13T18:21:00.532216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-13T18:21:00.532230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-13T18:21:00.532245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-13T18:21:00.532259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-13T18:21:00.532273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 3482360 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:21:00.532275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.532279Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.532442Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.532453Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 3 size 8295638
2025-10-13T18:21:00.532460Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 3 count 2 size 2970333
2025-10-13T18:21:00.532467Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000003_00015?(+) to d0000000000_00000000000000000016_00000_0000000003_00015?(+)
2025-10-13T18:21:00.532469Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000019_00003_0000000001_00001?(+) to d0000000000_00000000000000000019_00003_0000000001_00001?(+)
2025-10-13T18:21:00.532471Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000002_00006|(+) to d0000000000_00000000000000000014_00002_0000000002_00006|(+)
2025-10-13T18:21:00.532480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-13T18:21:00.532482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000002_00008?
2025-10-13T18:21:00.532490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000003_00015?
2025-10-13T18:21:00.532498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00003_0000000002_00005?
2025-10-13T18:21:00.532510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-13T18:21:00.533422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.533425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 22 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.533429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.533446Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-13T18:21:00.533471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:21:00.533476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:21:00.533476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-13T18:21:00.533479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 3 count 2 parts 5 suffix '63'
2025-10-13T18:21:00.533479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:21:00.533487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.533497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 19 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:21:00.533501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-13T18:21:00.533505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:21:00.533530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.533536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.533667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-13T18:21:00.533809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-13T18:21:00.533958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-13T18:21:00.534088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-13T18:21:00.534271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-13T18:21:00.534644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-13T18:21:00.534655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-13T18:21:00.534782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-13T18:21:00.534910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-13T18:21:00.535059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-13T18:21:00.536038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.536371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.537205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 27 }
2025-10-13T18:21:00.537219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 24
2025-10-13T18:21:00.537228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.537348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 24 }
2025-10-13T18:21:00.537352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 25
2025-10-13T18:21:00.537376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 39 queued_in_partition_duration_ms: 13 }
2025-10-13T18:21:00.537379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 26
2025-10-13T18:21:00.537395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 9 }
2025-10-13T18:21:00.537398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 27
2025-10-13T18:21:00.538328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 34 to 34
2025-10-13T18:21:00.538597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.538608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-13T18:21:00.536647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295660
2025-10-13T18:21:00.536726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-13T18:21:00.536739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295660 WTime 1760379660536
2025-10-13T18:21:00.536856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-13T18:21:00.536865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.537003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-13T18:21:00.537131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-13T18:21:00.537261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-13T18:21:00.537383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-13T18:21:00.537548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-13T18:21:00.538024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 2970343 count 2 nextOffset 23 batches 6
2025-10-13T18:21:00.538033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-13T18:21:00.538155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-13T18:21:00.538289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-13T18:21:00.538419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-13T18:21:00.538591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-13T18:21:00.539183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 5223541 count 3 nextOffset 24 batches 10
2025-10-13T18:21:00.539190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-13T18:21:00.539326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-13T18:21:00.539458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-13T18:21:00.539589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-13T18:21:00.539776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-13T18:21:00.540327Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.540713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 7476739 count 4 nextOffset 25 batches 14
2025-10-13T18:21:00.541098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-13T18:21:00.541105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-13T18:21:00.543549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 35 to 35
2025-10-13T18:21:00.543801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.543813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-13T18:21:00.545038Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.548223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 36 to 36
2025-10-13T18:21:00.548491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.548503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-13T18:21:00.549552Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.542302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988760
2025-10-13T18:21:00.542320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-13T18:21:00.542329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.542440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-13T18:21:00.542608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-13T18:21:00.542621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988760 WTime 1760379660542
2025-10-13T18:21:00.542903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-13T18:21:00.542911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-13T18:21:00.543041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-13T18:21:00.543176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-13T18:21:00.543301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-13T18:21:00.543360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-13T18:21:00.543791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-13T18:21:00.543872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 18 endOffset 20 curOffset 27 d0000000000_00000000000000000025_00001_0000000002_00007| size 3994387 WTime 1760379660543
2025-10-13T18:21:00.545438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-13T18:21:00.545668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 1 cbcount 2
2025-10-13T18:21:00.545791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.545938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.546071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.546264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:21:00.546406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.546536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.546662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.546834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:21:00.546954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.547074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.547198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.547258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:21:00.547493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-13T18:21:00.547656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.547782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.548456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:21:00.548578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.548770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.548901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.548968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:21:00.549293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:21:00.549439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.549567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.550030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.550790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:21:00.550908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.551233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.551674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:21:00.551734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:21:00.551803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 19 size 717135 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.551805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.551811Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.551904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.551914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.552343Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.552365Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295660
2025-10-13T18:21:00.552373Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988760
2025-10-13T18:21:00.552385Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 2 size 3994387
2025-10-13T18:21:00.552460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 11
2025-10-13T18:21:00.553445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 37 to 37
2025-10-13T18:21:00.553694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.553706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-13T18:21:00.553714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.553758Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.564349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-13T18:21:00.564517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 3 size 8295638 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.564525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 2 size 2970333 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.564549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.564568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.564576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-13T18:21:00.564591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-13T18:21:00.564596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-13T18:21:00.564601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-13T18:21:00.564611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-13T18:21:00.564617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-13T18:21:00.564622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-13T18:21:00.564627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-13T18:21:00.564632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-13T18:21:00.564638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-13T18:21:00.564640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:21:00.564643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-13T18:21:00.564646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.564647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-13T18:21:00.564651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:21:00.564653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-13T18:21:00.564658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-13T18:21:00.564663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-13T18:21:00.564668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:21:00.564670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-13T18:21:00.564675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-13T18:21:00.564680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-13T18:21:00.564685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-13T18:21:00.564690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-13T18:21:00.564695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-13T18:21:00.564700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-13T18:21:00.564704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-13T18:21:00.564710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-13T18:21:00.564716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.564719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-13T18:21:00.564761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.564769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.564771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.564783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.564797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-13T18:21:00.564811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-13T18:21:00.564818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-13T18:21:00.564827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 20 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.564829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.564833Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.564844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-13T18:21:00.564852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-13T18:21:00.572057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.573571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 29 }
2025-10-13T18:21:00.572096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.573590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 28
2025-10-13T18:21:00.572108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.572114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.573598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.572119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.572125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.573797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.574003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 38 to 38
2025-10-13T18:21:00.574168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.574264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.574276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-13T18:21:00.574282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.574329Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.574854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 26 }
2025-10-13T18:21:00.574866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 29
2025-10-13T18:21:00.574870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.574954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 24 }
2025-10-13T18:21:00.574959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 30
2025-10-13T18:21:00.574992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 20 }
2025-10-13T18:21:00.575006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 31
2025-10-13T18:21:00.575032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 17 }
2025-10-13T18:21:00.575035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 32
2025-10-13T18:21:00.575180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.575208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.575291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-13T18:21:00.575346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-13T18:21:00.575404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-13T18:21:00.575463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-13T18:21:00.575499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-13T18:21:00.575509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-13T18:21:00.575547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.575576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.575593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.575600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:21:00.575637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-13T18:21:00.575656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-13T18:21:00.575659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-13T18:21:00.575662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-13T18:21:00.575668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-13T18:21:00.576077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2253230 count 1 nextOffset 33 batches 5
2025-10-13T18:21:00.576102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.576210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,1 HeadOffset 32 endOffset 32 curOffset 33 d0000000000_00000000000000000032_00000_0000000001_00004? size 2253220 WTime 1760379660575
2025-10-13T18:21:00.576397Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 27 Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660369 CreateTimestampMS: 1760379660320 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660369 CreateTimestampMS: 1760379660326 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660392 CreateTimestampMS: 1760379660335 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 15 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660393 CreateTimestampMS: 1760379660346 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 16 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660394 CreateTimestampMS: 1760379660352 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 17 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660407 CreateTimestampMS: 1760379660359 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 18 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760379660408 CreateTimestampMS: 1760379660365 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 1 BlobsFromCache: 1 SizeLag: 1536704 RealReadOffset: 17 WaitQuotaTimeMs: 0 EndOffset: 27 StartOffset: 0 } Cookie: 11 }
2025-10-13T18:21:00.576495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.576508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.576523Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.576537Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 1 size 2253220
2025-10-13T18:21:00.576613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-13T18:21:00.576790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.577334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 39 to 39
2025-10-13T18:21:00.577588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.577599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-13T18:21:00.577643Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.579953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.580269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.581995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 40 to 40
2025-10-13T18:21:00.586412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.586436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-13T18:21:00.586500Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-13T18:21:00.586462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.586497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.586583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-13T18:21:00.586643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-13T18:21:00.586701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-13T18:21:00.586759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-13T18:21:00.586797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-13T18:21:00.586811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-13T18:21:00.586850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.586855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.586917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.586927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.586949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.586972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-13T18:21:00.587255Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 18 endOffset 27
2025-10-13T18:21:00.587283Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 27 ReadOffset 18 ReadGuid 2e4b395c-ee978ba3-a8242967-d2161af has messages 1
2025-10-13T18:21:00.587306Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 18, endOffset# 27, WTime# 1760379660408, sizeLag# 1536704
2025-10-13T18:21:00.587312Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:21:00.587337Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 read done: guid# 2e4b395c-ee978ba3-a8242967-d2161af, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 15770637
2025-10-13T18:21:00.587362Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 response to read: guid# 2e4b395c-ee978ba3-a8242967-d2161af
2025-10-13T18:21:00.589928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 41 to 41
2025-10-13T18:21:00.588899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.590218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.590233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-13T18:21:00.590312Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.590738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.591056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.591606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.591628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.591715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-13T18:21:00.591773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-13T18:21:00.591824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-13T18:21:00.591880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-13T18:21:00.591947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-13T18:21:00.591953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-13T18:21:00.591992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.591996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.592008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.592034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.592052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-13T18:21:00.592145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.593118Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 Process answer. Aval parts: 1
2025-10-13T18:21:00.594013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 42 to 42
2025-10-13T18:21:00.594305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.594319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-13T18:21:00.593799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.594105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.594899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.594963Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.594963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.594988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.595086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-13T18:21:00.595184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-13T18:21:00.595703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-13T18:21:00.595801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-13T18:21:00.595846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-13T18:21:00.595853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-13T18:21:00.595890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.595894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.595909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.595952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.595972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-13T18:21:00.596478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.597971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.598280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.598841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.598862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.598935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-13T18:21:00.598983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-13T18:21:00.599035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-13T18:21:00.599093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-13T18:21:00.599130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-13T18:21:00.599135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-13T18:21:00.599182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.599186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.599201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.599228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.599248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-13T18:21:00.599526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.603100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.603410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.604345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.604369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.604819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-13T18:21:00.605221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-13T18:21:00.605276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-13T18:21:00.605361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-13T18:21:00.605399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-13T18:21:00.605404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-13T18:21:00.605447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.605450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.605464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.605491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.605510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-13T18:21:00.605827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.607617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.607900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.608588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.608609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.608686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-13T18:21:00.608735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-13T18:21:00.608805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-13T18:21:00.608854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-13T18:21:00.608888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-13T18:21:00.608893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-13T18:21:00.608938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.608962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.609417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.609425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.609454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-13T18:21:00.609552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.610945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295660 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.610957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988760 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.610962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 3994387 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.610984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.611005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.611019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-13T18:21:00.611025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:21:00.611012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.611031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:21:00.611034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-13T18:21:00.611037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-13T18:21:00.611602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.611615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-13T18:21:00.611618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000002_00005?
2025-10-13T18:21:00.611621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11265971 bytes
2025-10-13T18:21:00.611637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:21:00.611647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.611650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 2970333 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.611656Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.612477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.612502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.612608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-13T18:21:00.612685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-13T18:21:00.612747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-13T18:21:00.612816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-13T18:21:00.612860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-13T18:21:00.612870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-13T18:21:00.612895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:21:00.612903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-13T18:21:00.612921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000002_00005?
2025-10-13T18:21:00.612934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:21:00.612959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.612988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.613003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.613011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.613023Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:21:00.613058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:21:00.613068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 2 parts 5 suffix '63'
2025-10-13T18:21:00.613223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.613235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.613365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-13T18:21:00.613373Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Got ReadResponse, serverBytesSize = 15770637, now ReadSizeBudget = 0, ReadSizeServerDelta = -15246349
2025-10-13T18:21:00.613449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.613505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-13T18:21:00.613567Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-13T18:21:00.613584Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 15770637 to budget
2025-10-13T18:21:00.613647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-13T18:21:00.613785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-13T18:21:00.614012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-13T18:21:00.615051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-13T18:21:00.615072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-13T18:21:00.615212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-13T18:21:00.615369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-13T18:21:00.615513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-13T18:21:00.615739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-13T18:21:00.624711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295604
2025-10-13T18:21:00.624739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295604 WTime 1760379660624
2025-10-13T18:21:00.624766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-13T18:21:00.624778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-13T18:21:00.624902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-13T18:21:00.625044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-13T18:21:00.625183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-13T18:21:00.625269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-13T18:21:00.626010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-13T18:21:00.626405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-13T18:21:00.626419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-13T18:21:00.626422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-13T18:21:00.626431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.626547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-13T18:21:00.626732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-13T18:21:00.627206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-10-13T18:21:00.627227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-13T18:21:00.627356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-13T18:21:00.627485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-13T18:21:00.627618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-13T18:21:00.627672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-13T18:21:00.628141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
2025-10-13T18:21:00.628228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,4 HeadOffset 25 endOffset 27 curOffset 32 d0000000000_00000000000000000028_00004_0000000004_00012| size 6964702 WTime 1760379660627
2025-10-13T18:21:00.633051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.633070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.633448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.635249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.635552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.633186Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.633209Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295604
2025-10-13T18:21:00.633218Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 6964702
2025-10-13T18:21:00.633250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 2253220 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.633305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-13T18:21:00.633311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-13T18:21:00.633312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:21:00.633328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.633350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.633357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.633366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-13T18:21:00.633371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.633377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-13T18:21:00.633378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.633383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-13T18:21:00.633385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.633389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-13T18:21:00.633395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.633400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-13T18:21:00.633434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.633463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.633466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (35)
2025-10-13T18:21:00.633490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-13T18:21:00.633501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-13T18:21:00.633504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-13T18:21:00.633508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-13T18:21:00.633513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-13T18:21:00.633939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 2253230 count 1 nextOffset 34 batches 5
2025-10-13T18:21:00.633958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-13T18:21:00.633965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-13T18:21:00.633969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-13T18:21:00.633971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-13T18:21:00.633975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-13T18:21:00.634455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 4506428 count 2 nextOffset 35 batches 9
2025-10-13T18:21:00.634472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-13T18:21:00.634478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-13T18:21:00.634481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-13T18:21:00.634484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-13T18:21:00.634488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-13T18:21:00.634967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 6759626 count 3 nextOffset 36 batches 13
2025-10-13T18:21:00.634986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-13T18:21:00.634991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-13T18:21:00.634995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-13T18:21:00.634999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-13T18:21:00.636494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 37 partNo 3 result is x0000000000_00000000000000000033_00000_0000000003_00015? size 8295638
2025-10-13T18:21:00.636512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-13T18:21:00.636525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000033_00000_0000000003_00015? new key d0000000000_00000000000000000033_00000_0000000003_00015? size 8295638 WTime 1760379660636
2025-10-13T18:21:00.636636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 1 NewHead: Offset 36 PartNo 3 PackedSize 717145 count 1 nextOffset 37 batches 2
2025-10-13T18:21:00.636652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-13T18:21:00.636658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-13T18:21:00.636661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-13T18:21:00.636666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-13T18:21:00.636669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-13T18:21:00.637170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 3 PackedSize 2970343 count 2 nextOffset 38 batches 6
2025-10-13T18:21:00.637184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-13T18:21:00.637190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-13T18:21:00.637195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-13T18:21:00.637199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-13T18:21:00.637202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-13T18:21:00.637975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 3 PackedSize 5223541 count 3 nextOffset 39 batches 10
2025-10-13T18:21:00.637988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-13T18:21:00.637994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-13T18:21:00.637997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-13T18:21:00.638001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-13T18:21:00.638004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-13T18:21:00.638497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 3 PackedSize 7476739 count 4 nextOffset 40 batches 14
2025-10-13T18:21:00.638508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.638607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,4 HeadOffset 33 endOffset 33 curOffset 40 d0000000000_00000000000000000036_00003_0000000004_00013? size 7476729 WTime 1760379660638
2025-10-13T18:21:00.644353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.644440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295660 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.644450Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.644495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-13T18:21:00.644742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.645144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 57 }
2025-10-13T18:21:00.645169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 33
2025-10-13T18:21:00.645175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.645555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 43 to 43
2025-10-13T18:21:00.645838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.645901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.645224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.645914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-13T18:21:00.645246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.645327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-13T18:21:00.645406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-13T18:21:00.645460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-13T18:21:00.645513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-13T18:21:00.645550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-13T18:21:00.645555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-13T18:21:00.645585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.645590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.645597Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.645612Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 3 size 8295638
2025-10-13T18:21:00.645619Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 3 count 4 size 7476729
2025-10-13T18:21:00.645626Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000002_00008?(+) to d0000000000_00000000000000000020_00000_0000000002_00008?(+)
2025-10-13T18:21:00.645628Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000003_00015?(+) to d0000000000_00000000000000000022_00000_0000000003_00015?(+)
2025-10-13T18:21:00.645630Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00003_0000000002_00005?(+) to d0000000000_00000000000000000025_00003_0000000002_00005?(+)
2025-10-13T18:21:00.645633Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000002_00008|(+) to d0000000000_00000000000000000018_00000_0000000002_00008|(+)
2025-10-13T18:21:00.645647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.645671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.645752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-13T18:21:00.646948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.647220Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (11-11)
2025-10-13T18:21:00.647240Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:21:00.647289Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-13T18:21:00.647305Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.647735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.648034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-13T18:21:00.320000Z WriteTime: 2025-10-13T18:21:00.369000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.648271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.648284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.648356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-13T18:21:00.648532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-13T18:21:00.648588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-13T18:21:00.648644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-13T18:21:00.648687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-13T18:21:00.648692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-13T18:21:00.648720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.648723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.648732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.648755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.648767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-13T18:21:00.649138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.651207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.651225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.651294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-13T18:21:00.651353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-13T18:21:00.651476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-13T18:21:00.651536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-13T18:21:00.651587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-13T18:21:00.651595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-13T18:21:00.651615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.651637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.658292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295604 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.658307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 6964702 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.658343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.658343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-13T18:21:00.658349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-13T18:21:00.658364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-13T18:21:00.659450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.659465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:21:00.659480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988760 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.659485Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.669566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.669603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.669625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.669632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.669642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.669648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.669655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.666499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 3 size 8295638 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.666512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 4 size 7476729 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.666528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.666539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-13T18:21:00.666544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.666548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.666548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 15770377 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.666552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:21:00.666554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-13T18:21:00.666556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-13T18:21:00.666575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-13T18:21:00.666580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-13T18:21:00.666586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-13T18:21:00.666599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-13T18:21:00.666610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-13T18:21:00.666617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-13T18:21:00.666623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-13T18:21:00.666628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-13T18:21:00.666636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-13T18:21:00.666642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-13T18:21:00.666648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-13T18:21:00.666654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-13T18:21:00.666658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-13T18:21:00.666664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-13T18:21:00.666670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-13T18:21:00.666674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-13T18:21:00.666685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-13T18:21:00.666691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-13T18:21:00.666696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-13T18:21:00.671358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 46 }
2025-10-13T18:21:00.666702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.671379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 34
2025-10-13T18:21:00.671405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.666706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-13T18:21:00.666708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-13T18:21:00.666713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-13T18:21:00.666719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-13T18:21:00.666726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-13T18:21:00.666733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-13T18:21:00.666741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-10-13T18:21:00.666746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-10-13T18:21:00.666752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-10-13T18:21:00.666756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-10-13T18:21:00.666762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-13T18:21:00.666766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-10-13T18:21:00.666771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-10-13T18:21:00.666777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-10-13T18:21:00.671515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 41 }
2025-10-13T18:21:00.671525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 35
2025-10-13T18:21:00.666782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.666785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-10-13T18:21:00.666842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.666858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.666863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-13T18:21:00.666889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-13T18:21:00.666901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-13T18:21:00.666904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-13T18:21:00.666907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-13T18:21:00.666911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-13T18:21:00.667353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-13T18:21:00.667371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-13T18:21:00.667378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-13T18:21:00.667381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-13T18:21:00.667384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-13T18:21:00.667388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-13T18:21:00.667859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-13T18:21:00.667872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-13T18:21:00.667877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-13T18:21:00.667880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-13T18:21:00.667883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-13T18:21:00.667886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-13T18:21:00.668367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-13T18:21:00.668378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.668589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 40,3 HeadOffset 40 endOffset 40 curOffset 43 d0000000000_00000000000000000040_00000_0000000003_00012? size 6759616 WTime 1760379660668
2025-10-13T18:21:00.669336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00004?
2025-10-13T18:21:00.669339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000003_00015?
2025-10-13T18:21:00.669342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 10548858 bytes
2025-10-13T18:21:00.669388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 3994387 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:21:00.669392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 2970333 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.669395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.669399Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.669421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-13T18:21:00.669454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-13T18:21:00.669468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-13T18:21:00.669481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-13T18:21:00.669496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-13T18:21:00.669509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-13T18:21:00.669521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-13T18:21:00.669645Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.669660Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 6759616
2025-10-13T18:21:00.669667Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00015?(+) to d0000000000_00000000000000000027_00000_0000000003_00015?(+)
2025-10-13T18:21:00.669668Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00003_0000000002_00005?(+) to d0000000000_00000000000000000030_00003_0000000002_00005?(+)
2025-10-13T18:21:00.669670Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-10-13T18:21:00.669679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:21:00.669682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000001_00004?
2025-10-13T18:21:00.669691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000003_00015?
2025-10-13T18:21:00.669701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:21:00.669756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.669759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 33 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.669764Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:21:00.669796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.669800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.669800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:21:00.669809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:21:00.669937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-13T18:21:00.670069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-13T18:21:00.670197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-13T18:21:00.671809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988738
2025-10-13T18:21:00.671872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 44 to 44
2025-10-13T18:21:00.671966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-13T18:21:00.672040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-13T18:21:00.672062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988738 WTime 1760379660671
2025-10-13T18:21:00.672198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.672212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-13T18:21:00.672288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-10-13T18:21:00.672308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.672445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-13T18:21:00.672584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-13T18:21:00.672724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-13T18:21:00.672860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-13T18:21:00.673081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-13T18:21:00.673377Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.673582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 37 }
2025-10-13T18:21:00.673597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 36
2025-10-13T18:21:00.673574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 3482370 count 2 nextOffset 34 batches 7
2025-10-13T18:21:00.673591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-13T18:21:00.673666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 33 }
2025-10-13T18:21:00.673671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 37
2025-10-13T18:21:00.673697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 31 }
2025-10-13T18:21:00.673700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 38
2025-10-13T18:21:00.673709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-13T18:21:00.673727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 28 }
2025-10-13T18:21:00.673730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 39
2025-10-13T18:21:00.673754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 25 }
2025-10-13T18:21:00.673757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 40
2025-10-13T18:21:00.673849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-13T18:21:00.674017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-13T18:21:00.674050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.674214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-13T18:21:00.674416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.674722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 5735568 count 3 nextOffset 35 batches 11
2025-10-13T18:21:00.674740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-13T18:21:00.674857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-13T18:21:00.675000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-13T18:21:00.675140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-13T18:21:00.675195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-13T18:21:00.675647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 7988766 count 4 nextOffset 36 batches 15
2025-10-13T18:21:00.676126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-13T18:21:00.677215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 45 to 45
2025-10-13T18:21:00.677499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.677513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-13T18:21:00.678231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 37 partNo 0 result is x0000000000_00000000000000000032_00002_0000000004_00014 size 7988756
2025-10-13T18:21:00.678247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-13T18:21:00.678250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-13T18:21:00.678327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,4 HeadOffset 28 endOffset 32 curOffset 36 d0000000000_00000000000000000032_00002_0000000004_00014| size 7988756 WTime 1760379660678
2025-10-13T18:21:00.678835Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (12-12)
2025-10-13T18:21:00.678857Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-13T18:21:00.326000Z WriteTime: 2025-10-13T18:21:00.369000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.679994Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-10-13T18:21:00.680007Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.681702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.681717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.681736Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.681751Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988738
2025-10-13T18:21:00.681764Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 4 size 7988756
2025-10-13T18:21:00.682044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-13T18:21:00.682168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.682959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 40 count 3 size 6759616 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.682985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.683017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.683028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 46 to 46
2025-10-13T18:21:00.683032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-13T18:21:00.683039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-13T18:21:00.683042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:21:00.683047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 1, Offset: 40 is stored on disk
2025-10-13T18:21:00.683048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 2, Offset: 40 is stored on disk
2025-10-13T18:21:00.683053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 3, Offset: 40 is stored on disk
2025-10-13T18:21:00.683064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 4, Offset: 40 is stored on disk
2025-10-13T18:21:00.683070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-13T18:21:00.683076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 1, Offset: 41 is stored on disk
2025-10-13T18:21:00.683082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 2, Offset: 41 is stored on disk
2025-10-13T18:21:00.683088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 3, Offset: 41 is stored on disk
2025-10-13T18:21:00.683095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 4, Offset: 41 is stored on disk
2025-10-13T18:21:00.683111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-13T18:21:00.683117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 1, Offset: 42 is stored on disk
2025-10-13T18:21:00.683123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 2, Offset: 42 is stored on disk
2025-10-13T18:21:00.683128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 3, Offset: 42 is stored on disk
2025-10-13T18:21:00.683137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.683141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 4, Offset: 42 is stored on disk
2025-10-13T18:21:00.683310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.683324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-13T18:21:00.683229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.683240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.683243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.683256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.683305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295604 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.683309Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.683318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-13T18:21:00.683348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-10-13T18:21:00.683358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
2025-10-13T18:21:00.683592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.683622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.683628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.684505Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.684056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.684367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.684621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 22 }
2025-10-13T18:21:00.684634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 41
2025-10-13T18:21:00.684705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 15 queued_in_partition_duration_ms: 18 }
2025-10-13T18:21:00.684708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 42
2025-10-13T18:21:00.684736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 14 queued_in_partition_duration_ms: 16 }
2025-10-13T18:21:00.684739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 43
2025-10-13T18:21:00.684622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.684640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.684715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-13T18:21:00.684770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-13T18:21:00.684824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-13T18:21:00.684882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-13T18:21:00.684920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-13T18:21:00.684924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-13T18:21:00.685068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.685077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.685087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.685110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.685131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.685134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:21:00.685166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-13T18:21:00.685184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-13T18:21:00.685191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-13T18:21:00.685197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-13T18:21:00.685201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-13T18:21:00.685633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 0 PackedSize 2253230 count 1 nextOffset 44 batches 5
2025-10-13T18:21:00.685656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.685768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 43,1 HeadOffset 43 endOffset 43 curOffset 44 d0000000000_00000000000000000043_00000_0000000001_00004? size 2253220 WTime 1760379660685
2025-10-13T18:21:00.686083Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.686103Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 0 count 1 size 2253220
2025-10-13T18:21:00.686119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-10-13T18:21:00.686220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.686811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.687950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.688245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 47 to 47
2025-10-13T18:21:00.688264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.688539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.688554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-13T18:21:00.688910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.688452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.688467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.688535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-13T18:21:00.688585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-13T18:21:00.688629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-13T18:21:00.688682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-13T18:21:00.688712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-13T18:21:00.688718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-13T18:21:00.688746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.688749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.688779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.688799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.688812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-13T18:21:00.689966Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (13-13)
2025-10-13T18:21:00.689987Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:21:00.690036Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (14-14)
2025-10-13T18:21:00.690056Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-13T18:21:00.335000Z WriteTime: 2025-10-13T18:21:00.392000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.691047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.691058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.691076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.691198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-13T18:21:00.691256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-13T18:21:00.691320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-13T18:21:00.691352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.691388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-13T18:21:00.691433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-13T18:21:00.691443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-13T18:21:00.691464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.691487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.691513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.691516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.691532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-13T18:21:00.691699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.693955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.693974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.694040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-13T18:21:00.694151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-13T18:21:00.694206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-13T18:21:00.694260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-13T18:21:00.694312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-13T18:21:00.694317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-13T18:21:00.694337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.694354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.695253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 48 to 48
2025-10-13T18:21:00.695579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.695592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-13T18:21:00.696845Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.700221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 49 to 49
2025-10-13T18:21:00.700651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.700663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-13T18:21:00.701490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.701800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.702269Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (14-14)
2025-10-13T18:21:00.702289Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-13T18:21:00.346000Z WriteTime: 2025-10-13T18:21:00.393000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:45578", "logtype": "unknown", "_ip": "ipv6:[::1]:45578" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.703350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.701984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.704050Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (15-15)
2025-10-13T18:21:00.702003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.702029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988738 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.704063Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.702034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 4 size 7988756 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.702073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.702114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-13T18:21:00.702120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:21:00.702125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-13T18:21:00.702129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '124' size 7988756
2025-10-13T18:21:00.703215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.703221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.703224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.703227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 14236345 bytes
2025-10-13T18:21:00.703248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-13T18:21:00.703273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 6964702 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:21:00.703276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 7476729 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.703280Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.703310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:21:00.703313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.703327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.703340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:21:00.703508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 3 count 4 parts_count 13 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.703514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 40 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-13T18:21:00.000000Z
2025-10-13T18:21:00.703522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-13T18:21:00.703542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 3 parts 12 suffix '63'
2025-10-13T18:21:00.703548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 3 count 4 parts_count 13
2025-10-13T18:21:00.705227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.705501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.707259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 50 to 50
2025-10-13T18:21:00.707673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.707692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-13T18:21:00.704403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 43 count 1 size 2253220 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.704436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.704456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.707939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.704473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.704483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-13T18:21:00.704488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.704491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 1, Offset: 43 is stored on disk
2025-10-13T18:21:00.704493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.704497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 2, Offset: 43 is stored on disk
2025-10-13T18:21:00.704500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.704503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 3, Offset: 43 is stored on disk
2025-10-13T18:21:00.704509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.704513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 4, Offset: 43 is stored on disk
2025-10-13T18:21:00.704552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.704569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.704571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-13T18:21:00.704598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-13T18:21:00.704611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-13T18:21:00.704614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-13T18:21:00.704617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-13T18:21:00.704621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-13T18:21:00.704779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:21:00.704784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 43 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:21:00.705581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 44 PartNo 0 PackedSize 2253230 count 1 nextOffset 45 batches 5
2025-10-13T18:21:00.705604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-13T18:21:00.705613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-13T18:21:00.705619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-13T18:21:00.705623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-13T18:21:00.705626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-13T18:21:00.706100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 44 PartNo 0 PackedSize 4506428 count 2 nextOffset 46 batches 9
2025-10-13T18:21:00.706112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-13T18:21:00.706117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-13T18:21:00.706121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-13T18:21:00.706124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-13T18:21:00.706128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-13T18:21:00.706597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 44 PartNo 0 PackedSize 6759626 count 3 nextOffset 47 batches 13
2025-10-13T18:21:00.706607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.706714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 44,3 HeadOffset 44 endOffset 44 curOffset 47 d0000000000_00000000000000000044_00000_0000000003_00012? size 6759616 WTime 1760379660706
2025-10-13T18:21:00.707761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.707806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 44
2025-10-13T18:21:00.707841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 2253220 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.707847Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.708726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.708751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.708857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-13T18:21:00.709163Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.709223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-13T18:21:00.709289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-13T18:21:00.709348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-13T18:21:00.709384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-13T18:21:00.709389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-13T18:21:00.709418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.709421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.709430Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.709448Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 44 partNo 0 count 3 size 6759616
2025-10-13T18:21:00.709457Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00000_0000000001_00004?(+) to d0000000000_00000000000000000032_00000_0000000001_00004?(+)
2025-10-13T18:21:00.709460Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000033_00000_0000000003_00015?(+) to d0000000000_00000000000000000033_00000_0000000003_00015?(+)
2025-10-13T18:21:00.709462Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00004_0000000004_00012|(+) to d0000000000_00000000000000000028_00004_0000000004_00012|(+)
2025-10-13T18:21:00.709472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.709495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.709580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-10-13T18:21:00.709732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.711858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.711874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.711957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-10-13T18:21:00.712154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 19 }
2025-10-13T18:21:00.712171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 44
2025-10-13T18:21:00.712009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-10-13T18:21:00.712064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-10-13T18:21:00.712115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-10-13T18:21:00.712150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-10-13T18:21:00.712154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-10-13T18:21:00.712188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.712208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.712868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 51 to 51
2025-10-13T18:21:00.713145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.713158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-13T18:21:00.713184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.713465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.713657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.713673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.713703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-10-13T18:21:00.714600Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (15-15)
2025-10-13T18:21:00.714621Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:21:00.714685Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (16-16)
2025-10-13T18:21:00.714703Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.713861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-13T18:21:00.352000Z WriteTime: 2025-10-13T18:21:00.394000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.716172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.716191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.716266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 99 size: 511959
2025-10-13T18:21:00.716327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 99 size: 511959
2025-10-13T18:21:00.716379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 99 size: 511959
2025-10-13T18:21:00.716435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 99 size: 511959
2025-10-13T18:21:00.716497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size: 205040
2025-10-13T18:21:00.716508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size 205040 offset: -1
2025-10-13T18:21:00.717193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.717418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.717456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.717450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.717466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-13T18:21:00.717469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:21:00.717480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 4 size 7476729 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.717523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.717523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:21:00.717530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-13T18:21:00.717534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.717659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-13T18:21:00.717842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-13T18:21:00.717871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00002_0000000004_00014 new key d0000000000_00000000000000000032_00002_0000000004_00014 size 7988756 WTime 1760379660717
2025-10-13T18:21:00.718282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 37 partNo 4 FormedBlobsCount 1 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-13T18:21:00.718308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-13T18:21:00.718436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-13T18:21:00.718571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-13T18:21:00.718903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-13T18:21:00.719220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-13T18:21:00.719585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 52 to 52
2025-10-13T18:21:00.720001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.720018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-13T18:21:00.721756Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.719887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-13T18:21:00.719914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-13T18:21:00.720106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-13T18:21:00.720324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-13T18:21:00.720512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-13T18:21:00.720765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-13T18:21:00.721826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 6759626 count 3 nextOffset 39 batches 13
2025-10-13T18:21:00.721837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-13T18:21:00.721992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-13T18:21:00.722146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-13T18:21:00.722290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-13T18:21:00.723482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 40 partNo 3 result is x0000000000_00000000000000000036_00000_0000000003_00015 size 8295638
2025-10-13T18:21:00.723547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-13T18:21:00.723559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000036_00000_0000000003_00015 new key d0000000000_00000000000000000036_00000_0000000003_00015 size 8295638 WTime 1760379660723
2025-10-13T18:21:00.725563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 53 to 53
2025-10-13T18:21:00.726007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.726026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-13T18:21:00.723955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 40 partNo 4 FormedBlobsCount 1 NewHead: Offset 39 PartNo 3 PackedSize 717145 count 1 nextOffset 40 batches 2
2025-10-13T18:21:00.723973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:21:00.724094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-13T18:21:00.724222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-13T18:21:00.724374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-13T18:21:00.724501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-13T18:21:00.724696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-13T18:21:00.725186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 2970343 count 2 nextOffset 41 batches 6
2025-10-13T18:21:00.725195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-13T18:21:00.725388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-13T18:21:00.725587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-13T18:21:00.725811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-13T18:21:00.726107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-13T18:21:00.727119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 5223541 count 3 nextOffset 42 batches 10
2025-10-13T18:21:00.727132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-13T18:21:00.727301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-13T18:21:00.727678Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (16-16)
2025-10-13T18:21:00.727701Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:21:00.727744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-13T18:21:00.728014Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (17-17)
2025-10-13T18:21:00.728032Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-13T18:21:00.359000Z WriteTime: 2025-10-13T18:21:00.407000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:45578", "_ip": "ipv6:[::1]:45578", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.727972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-13T18:21:00.728036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-13T18:21:00.728916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 7476739 count 4 nextOffset 43 batches 14
2025-10-13T18:21:00.729019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,4 HeadOffset 32 endOffset 36 curOffset 43 d0000000000_00000000000000000039_00003_0000000004_00013| size 7476729 WTime 1760379660723
2025-10-13T18:21:00.731011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 33 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.731027Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.731064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.731076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.731115Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.731134Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 8295638
2025-10-13T18:21:00.731142Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 3 count 4 size 7476729
2025-10-13T18:21:00.731425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 51
2025-10-13T18:21:00.731708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.732273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 54 to 54
2025-10-13T18:21:00.732557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.732573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-13T18:21:00.732582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.732629Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.733375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.733719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.734192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.734214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.734324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 101 size: 511959
2025-10-13T18:21:00.734434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 101 size: 511959
2025-10-13T18:21:00.734494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 101 size: 511959
2025-10-13T18:21:00.734568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 101 size: 511959
2025-10-13T18:21:00.734611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 101 size: 205040
2025-10-13T18:21:00.734623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 101 size 205040 offset: -1
2025-10-13T18:21:00.734652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.734661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.734672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.734698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.734840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 44 count 3 size 6759616 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.734867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 52
2025-10-13T18:21:00.734883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.734888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:21:00.734896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:21:00.734904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:21:00.734913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-13T18:21:00.734925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 1, Offset: 44 is stored on disk
2025-10-13T18:21:00.734933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 2, Offset: 44 is stored on disk
2025-10-13T18:21:00.734939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 3, Offset: 44 is stored on disk
2025-10-13T18:21:00.734949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 4, Offset: 44 is stored on disk
2025-10-13T18:21:00.734954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-13T18:21:00.734959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 1, Offset: 45 is stored on disk
2025-10-13T18:21:00.734965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 2, Offset: 45 is stored on disk
2025-10-13T18:21:00.734971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 3, Offset: 45 is stored on disk
2025-10-13T18:21:00.734977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 4, Offset: 45 is stored on disk
2025-10-13T18:21:00.734983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-13T18:21:00.734990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.734996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 1, Offset: 46 is stored on disk
2025-10-13T18:21:00.735015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.735022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 2, Offset: 46 is stored on disk
2025-10-13T18:21:00.735023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.735029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.735026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 3, Offset: 46 is stored on disk
2025-10-13T18:21:00.735028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:21:00.735032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 4, Offset: 46 is stored on disk
2025-10-13T18:21:00.735088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.735104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.735112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-13T18:21:00.735138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-13T18:21:00.735155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-13T18:21:00.735158Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-13T18:21:00.735161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-13T18:21:00.735166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-13T18:21:00.736590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.736884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.735587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 2253230 count 1 nextOffset 48 batches 5
2025-10-13T18:21:00.735617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-13T18:21:00.735625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-13T18:21:00.735628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-13T18:21:00.735632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-13T18:21:00.735635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-13T18:21:00.736173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 4506428 count 2 nextOffset 49 batches 9
2025-10-13T18:21:00.736193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-13T18:21:00.736200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-13T18:21:00.736203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-13T18:21:00.736207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-13T18:21:00.736210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-13T18:21:00.736874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 47 PartNo 0 PackedSize 6759626 count 3 nextOffset 50 batches 13
2025-10-13T18:21:00.736891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-13T18:21:00.736900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 1
2025-10-13T18:21:00.736904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 2
2025-10-13T18:21:00.736907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 3
2025-10-13T18:21:00.739837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 51 partNo 3 result is x0000000000_00000000000000000047_00000_0000000003_00015? size 8295638
2025-10-13T18:21:00.739847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 4
2025-10-13T18:21:00.739861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000047_00000_0000000003_00015? new key d0000000000_00000000000000000047_00000_0000000003_00015? size 8295638 WTime 1760379660739
2025-10-13T18:21:00.740316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 4 FormedBlobsCount 1 NewHead: Offset 50 PartNo 3 PackedSize 717145 count 1 nextOffset 51 batches 2
2025-10-13T18:21:00.740346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.740462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 50,1 HeadOffset 47 endOffset 47 curOffset 51 d0000000000_00000000000000000050_00003_0000000001_00001? size 717135 WTime 1760379660739
2025-10-13T18:21:00.740581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:21:00.740614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 7988738 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:21:00.740623Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:21:00.740662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 45
2025-10-13T18:21:00.740696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-13T18:21:00.740812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 47
2025-10-13T18:21:00.740821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.740854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.741088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.741191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 15 }
2025-10-13T18:21:00.741208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 45
2025-10-13T18:21:00.741214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:21:00.741327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 13 }
2025-10-13T18:21:00.741339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 46
2025-10-13T18:21:00.741627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 55 to 55
2025-10-13T18:21:00.741716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.741733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.741816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 103 size: 511959
2025-10-13T18:21:00.741887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 103 size: 511959
2025-10-13T18:21:00.741909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: try to update token
2025-10-13T18:21:00.741921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-13T18:21:00.741946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 103 size: 511959
2025-10-13T18:21:00.742007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 103 size: 511959
2025-10-13T18:21:00.742043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 103 size: 205040
2025-10-13T18:21:00.742052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 103 size 205040 offset: -1
2025-10-13T18:21:00.742081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.742088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.742109Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:21:00.742129Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 0 count 3 size 8295638
2025-10-13T18:21:00.742142Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 50 partNo 3 count 1 size 717135
2025-10-13T18:21:00.742154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.742175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.742239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 53
2025-10-13T18:21:00.742539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.743135Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (17-17)
2025-10-13T18:21:00.743155Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:21:00.743166Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] In ContinueReadingDataImpl, ReadSizeBudget = 15770637, ReadSizeServerDelta = -15246349
2025-10-13T18:21:00.743255Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:21:00.743266Z :DEBUG: [/Root] [/Root] [4fe73b69-1aefef5f-22050740-4aaa971f] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:21:00.743404Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 grpc read done: success# 1, data# { read_request { bytes_size: 15770637 } }
2025-10-13T18:21:00.743443Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 got read request: guid# 595440b6-5d2c2c7c-e94aa138-3cf384fe
2025-10-13T18:21:00.743460Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 performing read request: guid# 4fc5062a-8d480d92-aac0dc37-b37955bc, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:21:00.743480Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 18 EndOffset 27 ClientCommitOffset 0 committedOffset 0 Guid 4fc5062a-8d480d92-aac0dc37-b37955bc
2025-10-13T18:21:00.743912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.743936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.743974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 18 count 10 size 524288 endOffset 47 max time lag 0ms effective offset 18
2025-10-13T18:21:00.743995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 8295660 count 3 last offset 18, current partition end offset: 47
2025-10-13T18:21:00.744006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-10-13T18:21:00.744026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 18 partno 0 count 3 parts_count 15 actorID [2:7560773067374204920:2389]
2025-10-13T18:21:00.744038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 15. Have to read 1 of 1 from KV
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-13T18:21:00.365000Z WriteTime: 2025-10-13T18:21:00.408000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45578", "server": "ipv6:[::1]:45578", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:21:00.744183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 11 }
2025-10-13T18:21:00.744194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: acknoledged message 47
2025-10-13T18:21:00.744208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.744302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 18 partno 0 count 3 parts_count 15
2025-10-13T18:21:00.744533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.744806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.744821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.744884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 105 size: 511959
2025-10-13T18:21:00.744938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 1 messageNo: 105 size: 511959
2025-10-13T18:21:00.744990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 2 messageNo: 105 size: 511959
2025-10-13T18:21:00.745049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 3 messageNo: 105 size: 511959
2025-10-13T18:21:00.745085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 105 size: 205040
2025-10-13T18:21:00.745096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 105 size 205040 offset: -1
2025-10-13T18:21:00.745163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.745174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.745182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:21:00.745200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:21:00.745344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 54
2025-10-13T18:21:00.745355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:21:00.745383Z node 2 :PERSQUEUE ERROR: partition.cpp:2176: [72075186224037892][Partition][0][StateIdle] OnWrite topic 'rt3.dc1--test-topic' partition 0 commands are not processed at all, reason: Status: 128
ErrorReason: "KeyValue# 72075186224037892 OldKey# x0000000000_00000000000000000032_00002_0000000004_00014 does not exist in CmdRename(0) Marker# KV18"
Cookie: 1
2025-10-13T18:21:00.745411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.745506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_16580020182907490963_v1
2025-10-13T18:21:00.745532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:21:00.745608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7560773071092194402:2470]
2025-10-13T18:21:00.745628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-13T18:21:00.745673Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_16580020182907490963_v1
2025-10-13T18:21:00.745800Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745809Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745811Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745814Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745815Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745818Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745820Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745822Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745824Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745826Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745828Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745831Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745833Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745834Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745836Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745838Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745840Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745842Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745844Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745846Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:21:00.745849Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (ReadInfo) cookie 15
2025-10-13T18:21:00.746393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:21:00.746436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0
2025-10-13T18:21:00.746517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|85598e75-571cd69d-857c9de3-823ce0a9_0 is DEAD
2025-10-13T18:21:00.746689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-13T18:21:00.746698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session will restart in 0.008142s
2025-10-13T18:21:00.746721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: Do CDS request
2025-10-13T18:21:00.746727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Start write session. Will connect to endpoint: localhost:20438
2025-10-13T18:21:00.747234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 56 to 56
2025-10-13T18:21:00.747461Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.752073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write 1 messages with Id from 57 to 57
2025-10-13T18:21:00.752087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:21:00.752125Z :NOTICE: [/Invalid] [/Invalid] [7d3898be-53289551-2722636d-fd30f7fc] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:20438" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:20438. " }
2025-10-13T18:21:00.752418Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [2a32080141376566] Result# TEvPutResult {Id# [72075186224037892:1:6:2:4:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-13T18:21:00.752452Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1:6:2:5:717135:1] status# {Status# BLOCKED} Marker# BSVS03
2025-10-13T18:21:00.756578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:21:00.756694Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-13T18:21:00.756709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-13T18:21:00.756873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:21:00.756921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:45578
2025-10-13T18:21:00.756932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45578 proto=v1  topic=test-topic durationSec=0
2025-10-13T18:21:00.756937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-13T18:21:00.757519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-13T18:21:00.757557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-13T18:21:00.757558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-13T18:21:00.757560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-13T18:21:00.757567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7560773071092194549:2472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-13T18:21:00.758197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7560773071092194549:2472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-13T18:21:00.760875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7560773071092194549:2472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-13T18:21:00.763196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7560773071092194549:2472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-13T18:21:00.763209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7560773071092194549:2472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-13T18:21:00.763213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7560773071092194549:2472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-13T18:21:00.763222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-13T18:21:00.764212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-13T18:21:00.764714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-13T18:21:00.764925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-13T18:21:00.764936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-13T18:21:00.764949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-13T18:21:00.764997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-13T18:21:00.765042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7560773071669172507:2406]
2025-10-13T18:21:00.765646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-13T18:21:00.766040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-13T18:21:00.766107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-13T18:21:00.766553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-13T18:21:00.766624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:21:00.766630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:21:00.766631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:21:00.766632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:21:00.766633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:21:00.766635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:21:00.766636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:21:00.766637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:21:00.766638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:21:00.766640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014|
2025-10-13T18:21:00.766641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.766642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.766644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000043_00000_0000000001_00004?
2025-10-13T18:21:00.766645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000044_00000_0000000003_00012?
2025-10-13T18:21:00.766651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:21:00.766662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:21:00.766666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:21:00.766671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:21:00.766675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:21:00.766680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:21:00.766684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:21:00.766687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:21:00.766691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:21:00.766695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014|
2025-10-13T18:21:00.766699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.766704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.766708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000043_00000_0000000001_00004?
2025-10-13T18:21:00.766712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00000_0000000003_00012?
2025-10-13T18:21:00.766719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:21:00.766728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:21:00.766738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:21:00.766743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:21:00.766747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:21:00.766752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:21:00.766757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:21:00.766762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:21:00.766767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:21:00.766772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:21:00.766781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:21:00.766787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:21:00.766795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:21:00.766800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:21:00.766806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:21:00.766814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:21:00.766818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:21:00.766822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:21:00.766827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014|
2025-10-13T18:21:00.766832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988756 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014|
2025-10-13T18:21:00.766837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.766842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 4 size 7476729 so 0 eo 40 d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.766850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.766855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 40 count 3 size 6759616 so 0 eo 43 d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.766864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000043_00000_0000000001_00004?
2025-10-13T18:21:00.766869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 43 count 1 size 2253220 so 0 eo 44 d0000000000_00000000000000000043_00000_0000000001_00004?
2025-10-13T18:21:00.766873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00000_0000000003_00012?
2025-10-13T18:21:00.766882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 3 size 6759616 so 0 eo 47 d0000000000_00000000000000000044_00000_0000000003_00012?
2025-10-13T18:21:00.766923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-13T18:21:00.778409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:916: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 47 key 32,4 valuesize 7988756 expected 7988756
2025-10-13T18:21:00.780316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-13T18:21:00.780335Z node 2 :PERSQUEUE INFO: partition_init.cpp:965: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-13T18:21:00.780341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-13T18:21:00.780345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-13T18:21:00.780355Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7560773071669172507:2406]
2025-10-13T18:21:00.780373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 47 Head Offset 47 PartNo 0 PackedSize 0 count 0 nextOffset 47 batches 0
SYNC INIT sourceId  src_id seqNo 47 offset 46
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00003_0000000004_00013? size 7476729
SYNC INIT DATA KEY: d0000000000_00000000000000000040_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000043_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00000_0000000003_00012? size 6759616
2025-10-13T18:21:00.780395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4310: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-13T18:21:00.780404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.780407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.780409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.780429Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 47 offset: 46 MaxOffset: 47
2025-10-13T18:21:00.780440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-13T18:21:00.780448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-13T18:21:00.780537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.780547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.780550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000043_00000_0000000001_00004?
2025-10-13T18:21:00.780553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes
2025-10-13T18:21:00.780625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-13T18:21:00.780632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.780657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000003_00012?
2025-10-13T18:21:00.780674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000043_00000_0000000001_00004?
2025-10-13T18:21:00.780692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-13T18:21:00.780715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773071092194589:2472], now have 1 active actors on pipe
2025-10-13T18:21:00.780725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560773071092194538:2427], now have 1 active actors on pipe
2025-10-13T18:21:00.780733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 3 count 4 parts_count 13 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.780736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 40 partno 0 count 3 parts_count 12 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.780738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 43 partno 0 count 1 parts_count 4 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.780753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-13T18:21:00.780770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 47 max time lag 0ms effective offset 0
2025-10-13T18:21:00.780771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 3 count 4 parts_count 13
2025-10-13T18:21:00.780774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 40 partno 0 count 3 parts_count 12
2025-10-13T18:21:00.780777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 43 partno 0 count 1 parts_count 4
2025-10-13T18:21:00.780786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 47
2025-10-13T18:21:00.780790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-13T18:21:00.780830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.780804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-13T18:21:00.780838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-13T18:21:00.780850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-13T18:21:00.780835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-13T18:21:00.780856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.780862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.780915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b52455e-a4c567d5-ac6d88cf-cc35d84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-13T18:21:00.780927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:21:00.780935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:21:00.780937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:21:00.780947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:21:00.780960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-13T18:21:00.780988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:21:00.781277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.781290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.781315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:21:00.781461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 47 sessionId: src_id|9b52455e-a4c567d5-ac6d88cf-cc35d84_0
2025-10-13T18:21:00.781831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85598e75-571cd69d-857c9de3-823ce0a9_0] Write session established. Init response: last_sequence_number: 47 session_id: "src_id|9b52455e-a4c567d5-ac6d88cf-cc35d84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-13T18:21:00.784334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52455e-a4c567d5-ac6d88cf-cc35d84_0] Write session: try to update token
2025-10-13T18:21:00.784353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b52455e-a4c567d5-ac6d88cf-cc35d84_0] Send 10 message(s) (0 left), first sequence number is 48
2025-10-13T18:21:00.801730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|9b52455e-a4c567d5-ac6d88cf-cc35d84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:21:00.805782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:21:00.808004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:21:00.808031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:21:00.808056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-13T18:21:00.808059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:21:00.808062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-13T18:21:00.808065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-13T18:21:00.808074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 4 size 7476729 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.808078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 40 count 3 size 6759616 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.808081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 43 count 1 size 2253220 actorID [2:7560773071669172500:2406]
2025-10-13T18:21:00.808147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:21:00.808159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
VERIFY failed (2025-10-13T18:21:00.808305Z): Something went wrong
  ydb/core/persqueue/pqtablet/partition/partition_compaction.cpp:447
  BlobsForCompactionWereRead(): requirement false failed
2025-10-13T18:21:00.808280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-13T18:21:00.808298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:446: [72075186224037892][Partition][0][StateIdle] Can't append blob for key d0000000000_00000000000000000036_00003_0000000004_00013?
2025-10-13T18:21:00.810320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-13T18:21:00.810332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:21:00.810336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 43 partno 0 count 1 parts 4 suffix '63' size 2253220
NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char, std::__y1::char_traits<char>>, char const*, unsigned long)+423 (0x14A0B997)
NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...)+263 (0x14A02247)
2025-10-13T18:21:00.845492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 1 ReadOffset 18 EndOffset 27 InitDone 1 WaitForData 0, pipe: [1:7560773071092194618:2470]
2025-10-13T18:21:00.845574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_16580020182907490963_v1" Offset: 18 Count: 10 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7560773071092194402 RawX2: 4503603922340262 } Cookie: 18 } }
2025-10-13T18:21:00.846086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_16580020182907490963_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7560773071092194618:2470]
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+7690 (0x2455809A)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+5681 (0x24402EB1)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15618778)
NActors::TExecutorThread::Execute(NActors::TMailbox*, bool)+3317 (0x1565C135)
??+0 (0x15660243)
NActors::TExecutorThread::ProcessExecutorPool()+657 (0x1565FE51)
NActors::TExecutorThread::ThreadProc()+191 (0x15660A3F)
??+0 (0x14A0D7FD)
??+0 (0x7F9AF7FB5AC3)
??+0 (0x7F9AF80478C0)
