2025-10-13T18:35:25.923974Z :PropagateSessionClosed INFO: Random seed for debugging is 1760380525923960
2025-10-13T18:35:26.044484Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7560776788651098414:2243];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:35:26.044506Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-13T18:35:26.052424Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-13T18:35:26.052577Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-13T18:35:26.068373Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-13T18:35:26.068631Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-13T18:35:26.068892Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7560776790473972293:2262];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:35:26.068905Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/k678/0001f3/r3tmp/tmpVbKIQY/pdisk_1.dat
2025-10-13T18:35:26.160971Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-13T18:35:26.165591Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-13T18:35:26.165619Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-13T18:35:26.165863Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-13T18:35:26.165873Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-13T18:35:26.168710Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-13T18:35:26.168859Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-13T18:35:26.169153Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-13T18:35:26.175719Z node 2 :CONFIGS_DISPATCHER ERROR: configs_dispatcher.cpp:1229: Notification cookie mismatch for subscription [2:7560776790473972066:2073] 1760380526046674 != 1760380526046677
2025-10-13T18:35:26.176200Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-13T18:35:26.176258Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3763, node 1
2025-10-13T18:35:26.196126Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/k678/0001f3/r3tmp/yandexKvLRxb.tmp
2025-10-13T18:35:26.196138Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/k678/0001f3/r3tmp/yandexKvLRxb.tmp
2025-10-13T18:35:26.196222Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/k678/0001f3/r3tmp/yandexKvLRxb.tmp
2025-10-13T18:35:26.196267Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-13T18:35:26.199535Z INFO: TTestServer started on Port 21084 GrpcPort 3763
TClient is connected to server localhost:21084
PQClient connected to localhost:3763
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-13T18:35:26.224564Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
2025-10-13T18:35:26.236056Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976720657, at schemeshard: 72057594046644480
waiting...
waiting...
waiting...
2025-10-13T18:35:26.355790Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-13T18:35:26.557091Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7560776790473972416:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:35:26.557125Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:35:26.557280Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7560776790473972439:2300], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:35:26.557290Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:35:26.557295Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7560776790473972438:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-13T18:35:26.559338Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-13T18:35:26.568917Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715657, at schemeshard: 72057594046644480
2025-10-13T18:35:26.569098Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7560776790473972442:2301], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-13T18:35:26.649616Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7560776790473972470:2135] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-13T18:35:26.655107Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-13T18:35:26.656314Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7560776790473972485:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-13T18:35:26.656428Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZWE1YjE3ZmQtNWI2YjA4ZjMtZGQwZmJjNGYtNjE3ZjVjMDk=, ActorId: [2:7560776790473972414:2294], ActorState: ExecuteState, TraceId: 01k7fdp7yw9gpcg2tpmyt92150, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-13T18:35:26.656920Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-13T18:35:26.656314Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7560776788651099268:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-13T18:35:26.656941Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=MWExNjE2ODMtYmNlZGMwNjQtNDI5ZDQ4NjUtZmI3ZWI0MDA=, ActorId: [1:7560776788651099242:2323], ActorState: ExecuteState, TraceId: 01k7fdp8055cn9anyf34tryd9w, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-13T18:35:26.657034Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-13T18:35:26.692736Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-13T18:35:26.745362Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3763", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-13T18:35:26.816352Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k7fdp8652apn2drpwe75j91p, Database: , SessionId: ydb://session/3?node_id=1&id=OWZhZDZjNjAtYjY1NDcwNTUtMTZmZjg2NTQtYzNmYzA4NjE=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7560776788651099654:2929] 
2025-10-13T18:35:27.044668Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-13T18:35:27.052871Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-13T18:35:31.044363Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7560776788651098414:2243];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:35:31.044410Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-13T18:35:31.056123Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7560776790473972293:2262];send_to=[0:7307199536658146131:7762515];
2025-10-13T18:35:31.056156Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-13T18:35:31.969209Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720670:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-13T18:35:32.008980Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3763
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720671
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-13T18:35:32.039952Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7560776814420903836:3190] connected; active server actors: 1
2025-10-13T18:35:32.040021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-13T18:35:32.040339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-13T18:35:32.041176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-13T18:35:32.058160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-13T18:35:32.065051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-13T18:35:32.064493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-13T18:35:32.064605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-13T18:35:32.064615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-13T18:35:32.064628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-13T18:35:32.065191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776814420903857:2423], now have 1 active actors on pipe
2025-10-13T18:35:32.065210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776814420903835:3189], now have 1 active actors on pipe
2025-10-13T18:35:32.065425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:35:32.066837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:35:32.068536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776814420903901:3238], now have 1 active actors on pipe
2025-10-13T18:35:32.068702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:35:32.069723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:35:32.069950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-13T18:35:32.069975Z node 2 :PERSQUEUE DEBUG: partition.cpp:1281: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-13T18:35:32.070044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-13T18:35:32.070116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7560776816243776739:2388]
2025-10-13T18:35:32.070859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-13T18:35:32.070864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-13T18:35:32.070870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7560776816243776739:2388]
2025-10-13T18:35:32.070877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-13T18:35:32.071196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4310: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-13T18:35:32.071204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.071231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.071234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:35:32.071238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-13T18:35:32.071240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.071242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.071243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-13T18:35:32.071250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-13T18:35:32.071318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:35:32.071359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.073933Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720672. Ctx: { TraceId: 01k7fdpdac6wpcd36q8r5ttrfc, Database: , SessionId: ydb://session/3?node_id=1&id=ZDBhOTYzLTE5ZGVhODdiLWExYmU0MDMtZjg4YTlhMDA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-13T18:35:32.073776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:35:32.073825Z node 2 :PERSQUEUE DEBUG: partition.cpp:1385: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760380532113, TxId 281474976720671
2025-10-13T18:35:32.073832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.073834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.073860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.073905Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.075365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.076339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-13T18:35:32.076414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.076422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.076425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.076426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.076434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.076578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-13T18:35:32.076600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-13T18:35:32.076653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:35:32.078701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-13T18:35:32.078721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-13T18:35:32.079404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720671
    CreateStep: 1760380532113
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720671
    CreateStep: 1760380532113
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3763
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-13T18:35:32.090467Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-13T18:35:32.096145Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-13T18:35:32.096385Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-13T18:35:32.096391Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3763
2025-10-13T18:35:32.097100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-13T18:35:32.097114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-13T18:35:32.098991Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-13T18:35:32.099209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-13T18:35:32.099251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:37604
2025-10-13T18:35:32.099257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:37604 proto=v1  topic=test-topic durationSec=0
2025-10-13T18:35:32.099261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-13T18:35:32.099751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-13T18:35:32.099792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-13T18:35:32.099794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-13T18:35:32.099795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-13T18:35:32.099801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-13T18:35:32.100352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-13T18:35:32.132239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-13T18:35:32.132654Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904005:2443] connected; active server actors: 1
2025-10-13T18:35:32.132743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-13T18:35:32.132751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-13T18:35:32.136080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904005:2443] disconnected.
2025-10-13T18:35:32.136088Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904005:2443] disconnected; active server actors: 1
2025-10-13T18:35:32.136092Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904005:2443] disconnected no session
2025-10-13T18:35:32.158952Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760380532158 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-13T18:35:32.159024Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|41b20119-1d6c0c90-3118dd1c-1d4d349_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-13T18:35:32.159178Z :INFO: [] MessageGroupId [src] SessionId [src|41b20119-1d6c0c90-3118dd1c-1d4d349_0] Write session: close. Timeout = 0 ms
2025-10-13T18:35:32.159189Z :INFO: [] MessageGroupId [src] SessionId [src|41b20119-1d6c0c90-3118dd1c-1d4d349_0] Write session will now close
2025-10-13T18:35:32.159195Z :DEBUG: [] MessageGroupId [src] SessionId [src|41b20119-1d6c0c90-3118dd1c-1d4d349_0] Write session: aborting
2025-10-13T18:35:32.159344Z :INFO: [] MessageGroupId [src] SessionId [src|41b20119-1d6c0c90-3118dd1c-1d4d349_0] Write session: gracefully shut down, all writes complete
2025-10-13T18:35:32.159349Z :DEBUG: [] MessageGroupId [src] SessionId [src|41b20119-1d6c0c90-3118dd1c-1d4d349_0] Write session: destroy
2025-10-13T18:35:32.156664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-13T18:35:32.156680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-13T18:35:32.156684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7560776814420903971:2443] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-13T18:35:32.156694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-13T18:35:32.157772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776814420904028:2443], now have 1 active actors on pipe
2025-10-13T18:35:32.158024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.158032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.158064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|41b20119-1d6c0c90-3118dd1c-1d4d349_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-13T18:35:32.158077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.158083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.158086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:35:32.158100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.158118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-13T18:35:32.158149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:32.158393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.158397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.158410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:32.157881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-13T18:35:32.158529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|41b20119-1d6c0c90-3118dd1c-1d4d349_0
2025-10-13T18:35:32.160631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7560776814420904028:2443] destroyed
2025-10-13T18:35:32.160652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-13T18:35:32.160660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.160662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.160664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.160242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|41b20119-1d6c0c90-3118dd1c-1d4d349_0 grpc read done: success: 0 data: 
2025-10-13T18:35:32.160258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|41b20119-1d6c0c90-3118dd1c-1d4d349_0 grpc read failed
2025-10-13T18:35:32.160268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|41b20119-1d6c0c90-3118dd1c-1d4d349_0 grpc closed
2025-10-13T18:35:32.160274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|41b20119-1d6c0c90-3118dd1c-1d4d349_0 is DEAD
2025-10-13T18:35:32.160481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-13T18:35:32.168827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.168840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.168846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-13T18:35:32.236518Z :INFO: [/Root] [] [65ab73db-b9da3596-136baa08-10f54323] Open read subsessions to databases: { name: dc1, endpoint: localhost:3763, path: /Root }, { name: dc2, endpoint: localhost:3763, path: /Invalid }
2025-10-13T18:35:32.237451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-13T18:35:32.237577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-13T18:35:32.237601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:3763
2025-10-13T18:35:32.243710Z :INFO: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] Starting read session
2025-10-13T18:35:32.243737Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] Starting single session
2025-10-13T18:35:32.243989Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.243996Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.244001Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Reconnecting session to cluster  in 0.000000s
2025-10-13T18:35:32.269714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.269734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.269737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.348647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:35:32.349111Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Successfully connected. Initializing session
2025-10-13T18:35:32.351816Z :INFO: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Starting read session
2025-10-13T18:35:32.351831Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Starting single session
2025-10-13T18:35:32.351888Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.351892Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.351897Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] Reconnecting session to cluster  in 0.000000s
2025-10-13T18:35:32.351945Z :ERROR: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. 
2025-10-13T18:35:32.351952Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.351954Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.349473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-13T18:35:32.351989Z :INFO: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.349493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-13T18:35:32.349515Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-13T18:35:32.349517Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-13T18:35:32.349647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:35:32.349668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:49910
2025-10-13T18:35:32.349672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49910 proto=v1  topic=test-topic durationSec=0
2025-10-13T18:35:32.349675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-13T18:35:32.351226Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-13T18:35:32.351295Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read init: from# ipv6:[::1]:49910, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-13T18:35:32.351422Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 auth for : user
2025-10-13T18:35:32.353508Z :INFO: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got InitResponse. ReadSessionId: shared/user_1_1_7608381465141185768_v1
2025-10-13T18:35:32.353521Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-13T18:35:32.353574Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.352052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-13T18:35:32.352086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-13T18:35:32.352088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-13T18:35:32.352089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-13T18:35:32.352094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-13T18:35:32.352575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-13T18:35:32.352957Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Handle describe topics response
2025-10-13T18:35:32.352973Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 auth is DEAD
2025-10-13T18:35:32.352984Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 auth ok: topics# 1, initDone# 0
2025-10-13T18:35:32.353231Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 register session: topic# rt3.dc1--test-topic
2025-10-13T18:35:32.353676Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-13T18:35:32.353698Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# ef15564d-9db881fb-3447cc32-23954b58
2025-10-13T18:35:32.354258Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904060:2464] connected; active server actors: 1
2025-10-13T18:35:32.354421Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1704: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7560776814420904060:2464] session shared/user_1_1_7608381465141185768_v1
2025-10-13T18:35:32.354427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-13T18:35:32.354435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-13T18:35:32.354440Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_7608381465141185768_v1" (Sender=[1:7560776814420904050:2464], Pipe=[1:7560776814420904060:2464], Partitions=[], ActiveFamilyCount=0)
2025-10-13T18:35:32.354445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-13T18:35:32.354454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-13T18:35:32.354460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_7608381465141185768_v1" (Sender=[1:7560776814420904050:2464], Pipe=[1:7560776814420904060:2464], Partitions=[], ActiveFamilyCount=0)
2025-10-13T18:35:32.354468Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_7608381465141185768_v1" sender [1:7560776814420904050:2464] lock partition 0 for ReadingSession "shared/user_1_1_7608381465141185768_v1" (Sender=[1:7560776814420904050:2464], Pipe=[1:7560776814420904060:2464], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-13T18:35:32.354475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-13T18:35:32.354478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000022s
2025-10-13T18:35:32.354664Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_7608381465141185768_v1" ClientId: "user" PipeClient { RawX1: 7560776814420904060 RawX2: 4503603922340256 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-13T18:35:32.354685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-13T18:35:32.355505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7560776814420904069:2470]
2025-10-13T18:35:32.357583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776814420904069:2470], now have 1 active actors on pipe
2025-10-13T18:35:32.357623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.357632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.357647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_7608381465141185768_v1 on pipe: [1:7560776814420904069:2470]
2025-10-13T18:35:32.357677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.357684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.357687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:35:32.357730Z node 2 :PERSQUEUE DEBUG: partition.cpp:3708: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_7608381465141185768_v1
2025-10-13T18:35:32.357734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.357773Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.357972Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_7608381465141185768_v1:1 with generation 1
2025-10-13T18:35:32.356104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-13T18:35:32.356196Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904077:2463] connected; active server actors: 1
2025-10-13T18:35:32.356206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-13T18:35:32.356211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-13T18:35:32.356348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904077:2463] disconnected.
2025-10-13T18:35:32.356351Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904077:2463] disconnected; active server actors: 1
2025-10-13T18:35:32.356353Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7560776814420904077:2463] disconnected no session
2025-10-13T18:35:32.365350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-13T18:35:32.365368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-13T18:35:32.365372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7560776814420904053:2463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-13T18:35:32.365382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-13T18:35:32.366118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-13T18:35:32.368024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776814420904094:2463], now have 1 active actors on pipe
2025-10-13T18:35:32.368047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.368055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.368095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-13T18:35:32.368104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.368109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.368130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.368136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.368140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.368142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:35:32.368151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.368162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-13T18:35:32.368167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.368175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-13T18:35:32.368187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:32.369879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.369890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.369893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.376125Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760380532269 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-13T18:35:32.376145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-13T18:35:32.376200Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 sending to client partition status
2025-10-13T18:35:32.380107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.380124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.380164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:32.384375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760380532384 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-13T18:35:32.384405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-13T18:35:32.387118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 1 to 1
2025-10-13T18:35:32.384093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0
2025-10-13T18:35:32.389052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.389073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-13T18:35:32.392340Z :INFO: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-13T18:35:32.397875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 2 to 2
2025-10-13T18:35:32.400073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.400093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-13T18:35:32.401076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.403161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.403249Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-13T18:35:32.403333Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-13T18:35:32.403343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-13T18:35:32.403348Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-13T18:35:32.404022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.404050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.404114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-13T18:35:32.407400Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-13T18:35:32.407418Z :DEBUG: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.404282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.407668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.407694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.407856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-13T18:35:32.407909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-13T18:35:32.408111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-13T18:35:32.408166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-13T18:35:32.408223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-13T18:35:32.408228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-13T18:35:32.408251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.408280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.408292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.408296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:32.408334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-13T18:35:32.408347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-13T18:35:32.408351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-13T18:35:32.408354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-13T18:35:32.408358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-13T18:35:32.409334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-13T18:35:32.409350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.409456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760380532409
2025-10-13T18:35:32.411609Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.411624Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-13T18:35:32.414037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.414374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.419769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.419787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.420019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-13T18:35:32.423659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 3 to 3
2025-10-13T18:35:32.420484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.423582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.423600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.423681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-13T18:35:32.423747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-13T18:35:32.423801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-13T18:35:32.423858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-13T18:35:32.424092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-13T18:35:32.424098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-13T18:35:32.424204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.424230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.424246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.424266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.424284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.424291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.424301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-13T18:35:32.424304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.424308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-13T18:35:32.424310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.424314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-13T18:35:32.424318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.424322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-13T18:35:32.424329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.424333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-13T18:35:32.424576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-13T18:35:32.424584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-13T18:35:32.424589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.424600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.424603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:32.424630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-13T18:35:32.424641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-13T18:35:32.424644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-13T18:35:32.424648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-13T18:35:32.424651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-13T18:35:32.425074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-13T18:35:32.425089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.425320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760380532421
2025-10-13T18:35:32.425847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.425884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-13T18:35:32.425902Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.425915Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-13T18:35:32.425993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-13T18:35:32.426008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-13T18:35:32.426011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-13T18:35:32.426039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.426044Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-13T18:35:32.426060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.426228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.426368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.426501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.426639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.426708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.426737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760380532408 queuesize 0 startOffset 0
2025-10-13T18:35:32.427507Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-13T18:35:32.427520Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-13T18:35:32.427544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.427776Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-13T18:35:32.427779Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:35:32.427796Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# d8723c69-b465aba4-ab8e0b92-e4662e56, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.427824Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid d8723c69-b465aba4-ab8e0b92-e4662e56
2025-10-13T18:35:32.427050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.427065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.436749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.436780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-13T18:35:32.438843Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.442017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 13 }
2025-10-13T18:35:32.442040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 1
2025-10-13T18:35:32.441651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.441672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.441945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-13T18:35:32.441973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-13T18:35:32.441978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-13T18:35:32.441993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.442010Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-13T18:35:32.442030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.442208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.442578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.443123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.443645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.444174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.444247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.444301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:32.443980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.444314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.448359Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532408 CreateTimestampMS: 1760380532385 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-13T18:35:32.450856Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-13T18:35:32.450876Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid d8723c69-b465aba4-ab8e0b92-e4662e56 has messages 1
2025-10-13T18:35:32.450931Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# d8723c69-b465aba4-ab8e0b92-e4662e56, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-13T18:35:32.450949Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# d8723c69-b465aba4-ab8e0b92-e4662e56
2025-10-13T18:35:32.448446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.448463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.448576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.448599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-13T18:35:32.448615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.448626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.448633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.448642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.448651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-13T18:35:32.448655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.448659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-13T18:35:32.448661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.448667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-13T18:35:32.448669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.448673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-13T18:35:32.448681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.448685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-13T18:35:32.448731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.448735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.448738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.448750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.448762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-13T18:35:32.452801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 4 to 4
2025-10-13T18:35:32.453073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.453087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-13T18:35:32.452069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.452101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.452448Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 0
2025-10-13T18:35:32.452510Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-13T18:35:32.452514Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-13T18:35:32.452524Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760380532408, sizeLag# 2253219
2025-10-13T18:35:32.452526Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:35:32.456876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.456900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.456984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-13T18:35:32.457039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-13T18:35:32.457114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-13T18:35:32.457172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-13T18:35:32.457223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-13T18:35:32.457228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-13T18:35:32.457255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.457284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.457295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.457297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:32.457334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-13T18:35:32.457346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-13T18:35:32.457350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-13T18:35:32.457356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-13T18:35:32.457360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-13T18:35:32.457768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-13T18:35:32.457782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.457953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1760380532457
2025-10-13T18:35:32.458415Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.458430Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-13T18:35:32.460048Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.465334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 26 }
2025-10-13T18:35:32.465352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 2
2025-10-13T18:35:32.466198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 5 to 5
2025-10-13T18:35:32.468142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.468159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-13T18:35:32.468581Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-13T18:35:32.468656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.468993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.469231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.469265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.469297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-13T18:35:32.470259Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.470353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.470512Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-13T18:35:32.470526Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 2252976 to budget
2025-10-13T18:35:32.470771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.470798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.470819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.470825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.470834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-13T18:35:32.470838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.470843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-13T18:35:32.470846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.470850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-13T18:35:32.470852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.470856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-13T18:35:32.470864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.470870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-13T18:35:32.470920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.470924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.470926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.470936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.470951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-13T18:35:32.471077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.473480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 13 }
2025-10-13T18:35:32.473494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 3
2025-10-13T18:35:32.474094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 6 to 6
2025-10-13T18:35:32.474369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.474384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-13T18:35:32.474782Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-13T18:35:32.474801Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.474812Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-13T18:35:32.475680Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.475697Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.475270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.475287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.475896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-13T18:35:32.475974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-13T18:35:32.471674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.471703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.474197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.474498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.475434Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-13T18:35:32.475494Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# 212a63fa-b51ac247-fb2d2d1a-89065ddb
2025-10-13T18:35:32.475514Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 134884-aa54c1a8-98e9a266-83f00734, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.475542Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 134884-aa54c1a8-98e9a266-83f00734
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-13T18:35:32.385000Z WriteTime: 2025-10-13T18:35:32.408000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "logtype": "unknown", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.480522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-13T18:35:32.481031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-13T18:35:32.481111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-13T18:35:32.481128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-13T18:35:32.481216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.481235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.481268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.481279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.481301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.481345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.481368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.481379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:32.481428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-13T18:35:32.481448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-13T18:35:32.481452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-13T18:35:32.481456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-13T18:35:32.481459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-13T18:35:32.482363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-13T18:35:32.482397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.482524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00004? size 2253219 WTime 1760380532482
2025-10-13T18:35:32.483553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.482830Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.482859Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 2253219
2025-10-13T18:35:32.482880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-13T18:35:32.482961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 3 max time lag 0ms effective offset 1
2025-10-13T18:35:32.482978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 3
2025-10-13T18:35:32.482983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-13T18:35:32.483023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.483030Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-13T18:35:32.483045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.483183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.483294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.483451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.483595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.485578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.487670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 7 to 7
2025-10-13T18:35:32.487652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.487947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.488041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.488112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-13T18:35:32.493128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.493151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-13T18:35:32.495222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.495246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.495330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-13T18:35:32.495383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-13T18:35:32.495456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-13T18:35:32.495516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-13T18:35:32.495552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-13T18:35:32.495557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-13T18:35:32.495592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.495596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.495786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.495812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.495830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-13T18:35:32.498640Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.499970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.503162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.503184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.503719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-13T18:35:32.504176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-13T18:35:32.504232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-13T18:35:32.504283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-13T18:35:32.504318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-13T18:35:32.504324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-13T18:35:32.504360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 2253219 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.504396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.504400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.504413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.504433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.504439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.504443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.504462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.504468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.504479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-13T18:35:32.504483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.504489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-13T18:35:32.504491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.504494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-13T18:35:32.504495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.504498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-13T18:35:32.504504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.504508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-13T18:35:32.504546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.504557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.504560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:35:32.504586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-13T18:35:32.504597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-13T18:35:32.504601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-13T18:35:32.504604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-13T18:35:32.504607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-13T18:35:32.504787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 8 to 8
2025-10-13T18:35:32.505114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.505129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-13T18:35:32.507159Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.505045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-13T18:35:32.505073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-13T18:35:32.505079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-13T18:35:32.505083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-13T18:35:32.505086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-13T18:35:32.505089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-13T18:35:32.505597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-13T18:35:32.505607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.505707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,2 HeadOffset 4 endOffset 4 curOffset 6 d0000000000_00000000000000000004_00000_0000000002_00008? size 4506416 WTime 1760380532505
2025-10-13T18:35:32.509687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-13T18:35:32.509700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-13T18:35:32.509703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-13T18:35:32.509705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-13T18:35:32.509708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 9012876 bytes
2025-10-13T18:35:32.509762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-13T18:35:32.509788Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.509802Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 2 size 4506416
2025-10-13T18:35:32.509813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-13T18:35:32.509816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-13T18:35:32.509829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-13T18:35:32.509841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-13T18:35:32.509859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-13T18:35:32.509869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-13T18:35:32.509874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-13T18:35:32.511448Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-13T18:35:32.511579Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-13T18:35:32.511597Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 2252978 to budget
2025-10-13T18:35:32.501172Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532421 CreateTimestampMS: 1760380532395 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 1 }
2025-10-13T18:35:32.501523Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-13T18:35:32.501546Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 2 ReadGuid 134884-aa54c1a8-98e9a266-83f00734 has messages 1
2025-10-13T18:35:32.501580Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1760380532421, sizeLag# 2253329
2025-10-13T18:35:32.501586Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:32.501600Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 134884-aa54c1a8-98e9a266-83f00734, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-13T18:35:32.501609Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 134884-aa54c1a8-98e9a266-83f00734
2025-10-13T18:35:32.501992Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:32.503394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.503732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.512990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 9 to 9
2025-10-13T18:35:32.509937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.509946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.509949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.509952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.509965Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-13T18:35:32.510007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.510012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.510519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-13T18:35:32.511041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-13T18:35:32.511634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-13T18:35:32.511786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-13T18:35:32.511852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-13T18:35:32.512019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.512027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.512031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.512035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.512310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-13T18:35:32.512322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.512487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-13T18:35:32.513003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-13T18:35:32.513156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-13T18:35:32.513318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-13T18:35:32.513413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-13T18:35:32.514958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-13T18:35:32.514977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.512406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.512448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.515020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.515987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.516001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-13T18:35:32.515148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-13T18:35:32.515310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-13T18:35:32.515465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-13T18:35:32.515719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-13T18:35:32.515781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-13T18:35:32.516816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-13T18:35:32.516825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.516982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-13T18:35:32.517556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-13T18:35:32.517705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-13T18:35:32.517858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-13T18:35:32.517798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.519550Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-13T18:35:32.519577Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.519589Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-13T18:35:32.519673Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.519686Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.524006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 23 }
2025-10-13T18:35:32.524027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 4
2025-10-13T18:35:32.524739Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-13T18:35:32.524842Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# a63acc6d-27e69d08-915445cf-f019236d
2025-10-13T18:35:32.524865Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 16cf4d9-2c9ba972-75878590-e62f5bed, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.524892Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 16cf4d9-2c9ba972-75878590-e62f5bed
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-13T18:35:32.395000Z WriteTime: 2025-10-13T18:35:32.421000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.530419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-13T18:35:32.530627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-13T18:35:32.530644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760380532529
2025-10-13T18:35:32.530780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-13T18:35:32.530886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000003_00003_0000000001_00001| size 717134 WTime 1760380532530
2025-10-13T18:35:32.531911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.533831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 10 to 10
2025-10-13T18:35:32.534113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.534131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-13T18:35:32.532156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.532245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-13T18:35:32.532302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-13T18:35:32.532551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-13T18:35:32.532610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-13T18:35:32.532645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-13T18:35:32.532650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-13T18:35:32.532684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.532688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.532711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.532714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.532728Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.532745Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-13T18:35:32.532752Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 1 size 717134
2025-10-13T18:35:32.532768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.532795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.532861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-13T18:35:32.532932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 4 max time lag 0ms effective offset 2
2025-10-13T18:35:32.532950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 4
2025-10-13T18:35:32.532955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-13T18:35:32.532967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.532972Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-13T18:35:32.532988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.533179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.533337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.533486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.533907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.533991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.534033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-13T18:35:32.534652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.536463Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.536140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.538557Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532457 CreateTimestampMS: 1760380532415 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 2 }
2025-10-13T18:35:32.538814Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-13T18:35:32.538825Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 3 ReadGuid 16cf4d9-2c9ba972-75878590-e62f5bed has messages 1
2025-10-13T18:35:32.538854Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1760380532457, sizeLag# 2253329
2025-10-13T18:35:32.538859Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:32.538870Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 16cf4d9-2c9ba972-75878590-e62f5bed, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-13T18:35:32.538878Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 16cf4d9-2c9ba972-75878590-e62f5bed
2025-10-13T18:35:32.540156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.540581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.541132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 11 to 11
2025-10-13T18:35:32.541437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.541453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-13T18:35:32.541501Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:32.542730Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.544502Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-13T18:35:32.544598Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-13T18:35:32.544607Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 2252978 to budget
2025-10-13T18:35:32.544679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.544710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.545249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-13T18:35:32.545661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-13T18:35:32.546119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-13T18:35:32.546547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-13T18:35:32.546584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-13T18:35:32.546590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-13T18:35:32.546625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.546630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.546665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.546694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.546881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-13T18:35:32.548589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 12 to 12
2025-10-13T18:35:32.550697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.550714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-13T18:35:32.552109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.552077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 2 size 4506416 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.552103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.552124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.552131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-13T18:35:32.552145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-13T18:35:32.552151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-13T18:35:32.552159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-13T18:35:32.552171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-13T18:35:32.552177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-13T18:35:32.552182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-13T18:35:32.552187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-13T18:35:32.552193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-13T18:35:32.552199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.552206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-13T18:35:32.552256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.552272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.552276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:35:32.552302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-13T18:35:32.552315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-13T18:35:32.552319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-13T18:35:32.552323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-13T18:35:32.552326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-13T18:35:32.552385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:35:32.554856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-13T18:35:32.554899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-13T18:35:32.554912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-13T18:35:32.554916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-13T18:35:32.554919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-13T18:35:32.554923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-13T18:35:32.556961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 4506426 count 2 nextOffset 8 batches 9
2025-10-13T18:35:32.556986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.557115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,2 HeadOffset 6 endOffset 6 curOffset 8 d0000000000_00000000000000000006_00000_0000000002_00008? size 4506416 WTime 1760380532556
2025-10-13T18:35:32.562270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.564522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.568677Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-13T18:35:32.568701Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.568711Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-13T18:35:32.568793Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.568802Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.569051Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-13T18:35:32.569161Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# 6310d19c-2f4a399d-1b9fa250-4ff989d1
2025-10-13T18:35:32.569182Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 6971b86e-a4a77214-4ebf4a8f-916aaae4, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.569227Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid 6971b86e-a4a77214-4ebf4a8f-916aaae4
2025-10-13T18:35:32.567497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.567579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-13T18:35:32.567611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-13T18:35:32.572210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.572241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-13T18:35:32.415000Z WriteTime: 2025-10-13T18:35:32.457000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49910", "logtype": "unknown", "_ip": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.572855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.572878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.572963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-13T18:35:32.573026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-13T18:35:32.573083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-13T18:35:32.573141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-13T18:35:32.573194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-13T18:35:32.573211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-13T18:35:32.573264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.573268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.573280Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.573300Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 2 size 4506416
2025-10-13T18:35:32.573319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.573338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.573340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.573349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.573370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.573433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-13T18:35:32.573485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 524288 endOffset 6 max time lag 0ms effective offset 3
2025-10-13T18:35:32.573504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 2253219 count 1 last offset 3, current partition end offset: 6
2025-10-13T18:35:32.573508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-13T18:35:32.573517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.573522Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-10-13T18:35:32.573535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.573724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.573875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.574111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.574272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.574366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.574398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-13T18:35:32.576155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 47 queued_in_partition_duration_ms: 9 }
2025-10-13T18:35:32.576172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 5
2025-10-13T18:35:32.576523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 13 to 13
2025-10-13T18:35:32.576880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.576891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-13T18:35:32.578163Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.578719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 1 }
2025-10-13T18:35:32.578733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 6
2025-10-13T18:35:32.576779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.578699Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532480 CreateTimestampMS: 1760380532452 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 3 }
2025-10-13T18:35:32.578936Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 6
2025-10-13T18:35:32.578947Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 4 ReadGuid 6971b86e-a4a77214-4ebf4a8f-916aaae4 has messages 1
2025-10-13T18:35:32.578987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.579623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.579663Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 6, WTime# 1760380532480, sizeLag# 2253329
2025-10-13T18:35:32.579666Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:32.579684Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 6971b86e-a4a77214-4ebf4a8f-916aaae4, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252978
2025-10-13T18:35:32.579692Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 6971b86e-a4a77214-4ebf4a8f-916aaae4
2025-10-13T18:35:32.575728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.581673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.581696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.581767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-13T18:35:32.581822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-13T18:35:32.581876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-13T18:35:32.582113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-13T18:35:32.582150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-13T18:35:32.582156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-13T18:35:32.582186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.582189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.582202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.582230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.582246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-13T18:35:32.582589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 14 to 14
2025-10-13T18:35:32.582947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.582958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-13T18:35:32.582438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.584084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.584386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.584527Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:32.584588Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.588761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.588779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.588889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-13T18:35:32.588978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-13T18:35:32.589036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-13T18:35:32.589094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-13T18:35:32.589138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-13T18:35:32.589143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-13T18:35:32.589189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.589191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.589217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.589242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.589258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-13T18:35:32.590623Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 2252978, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728690
2025-10-13T18:35:32.590701Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-13T18:35:32.590709Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 2252978 to budget
2025-10-13T18:35:32.591152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 15 to 15
2025-10-13T18:35:32.593892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.593904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-13T18:35:32.595430Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-13T18:35:32.595446Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.595454Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252978, ReadSizeServerDelta = -1728690
2025-10-13T18:35:32.595514Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.595523Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.595973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.596806Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252978 } }
2025-10-13T18:35:32.596852Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# 146fb3da-921420c3-6d05edd3-2df79c20
2025-10-13T18:35:32.596872Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 94442e49-a25858ba-fab1da2e-e9be7899, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.596891Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 6 ClientCommitOffset 0 committedOffset 0 Guid 94442e49-a25858ba-fab1da2e-e9be7899
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-13T18:35:32.452000Z WriteTime: 2025-10-13T18:35:32.480000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "logtype": "unknown", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.597587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.597851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.603052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 16 to 16
2025-10-13T18:35:32.608637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.608657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-13T18:35:32.613311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-10-13T18:35:32.613371Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.613371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.613397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.613478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-13T18:35:32.613527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-13T18:35:32.613775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-13T18:35:32.614228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-13T18:35:32.614263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-13T18:35:32.614268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-13T18:35:32.614304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.614307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.614329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.614333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.614374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.614399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.614605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-13T18:35:32.614635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 2 size 524288 endOffset 6 max time lag 0ms effective offset 4
2025-10-13T18:35:32.614660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 4506416 count 2 last offset 4, current partition end offset: 6
2025-10-13T18:35:32.614664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-13T18:35:32.614679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.614685Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-13T18:35:32.614705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.615777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.616544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.616212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:35:32.618798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.619096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.619594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.619735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.620296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.621027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-13T18:35:32.621506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.621643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.621785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.621965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.622827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.622837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.622925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-13T18:35:32.622988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-13T18:35:32.623069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-13T18:35:32.623133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-13T18:35:32.623165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-13T18:35:32.623172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-13T18:35:32.623197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.623200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.623311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-13T18:35:32.623335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.623361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.623381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 2 size 4506416 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.623401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.623405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 717134 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.624038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:35:32.624047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-13T18:35:32.624050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-13T18:35:32.626268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-13T18:35:32.626289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.626310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.626317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-13T18:35:32.626335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-13T18:35:32.626340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-13T18:35:32.626346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-13T18:35:32.626360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-13T18:35:32.626367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-13T18:35:32.626373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-13T18:35:32.626379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-13T18:35:32.626385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-13T18:35:32.626394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.626398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-13T18:35:32.626442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.626467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.626470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-13T18:35:32.626499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-13T18:35:32.626511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-13T18:35:32.626515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-13T18:35:32.626519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-13T18:35:32.626523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-13T18:35:32.626970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2253229 count 1 nextOffset 9 batches 5
2025-10-13T18:35:32.626987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-13T18:35:32.626993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-13T18:35:32.626997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-13T18:35:32.627000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-13T18:35:32.627003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-13T18:35:32.627711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4506426 count 2 nextOffset 10 batches 9
2025-10-13T18:35:32.627725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-13T18:35:32.627731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-13T18:35:32.627734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-13T18:35:32.627737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-13T18:35:32.627741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-13T18:35:32.629284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 6759624 count 3 nextOffset 11 batches 13
2025-10-13T18:35:32.629310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-13T18:35:32.629319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-13T18:35:32.629323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-13T18:35:32.629327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-13T18:35:32.632016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.634079Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 6 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532504 CreateTimestampMS: 1760380532465 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532505 CreateTimestampMS: 1760380532473 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 198 RealReadOffset: 5 WaitQuotaTimeMs: 0 EndOffset: 6 StartOffset: 0 } Cookie: 4 }
2025-10-13T18:35:32.635994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.637901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.641524Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 6
2025-10-13T18:35:32.641548Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 6 ReadOffset 6 ReadGuid 94442e49-a25858ba-fab1da2e-e9be7899 has messages 1
2025-10-13T18:35:32.641628Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 94442e49-a25858ba-fab1da2e-e9be7899, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505940
2025-10-13T18:35:32.641637Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 94442e49-a25858ba-fab1da2e-e9be7899
2025-10-13T18:35:32.645244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 12 partNo 3 result is x0000000000_00000000000000000008_00000_0000000003_00015? size 8295636
2025-10-13T18:35:32.645272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-13T18:35:32.645295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000008_00000_0000000003_00015? new key d0000000000_00000000000000000008_00000_0000000003_00015? size 8295636 WTime 1760380532644
2025-10-13T18:35:32.645433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 1 NewHead: Offset 11 PartNo 3 PackedSize 717145 count 1 nextOffset 12 batches 2
2025-10-13T18:35:32.645448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-13T18:35:32.645453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-13T18:35:32.645457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-13T18:35:32.645461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-13T18:35:32.645466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-13T18:35:32.646001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 3 PackedSize 2970343 count 2 nextOffset 13 batches 6
2025-10-13T18:35:32.646014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.646365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,2 HeadOffset 8 endOffset 8 curOffset 13 d0000000000_00000000000000000011_00003_0000000002_00005? size 2970333 WTime 1760380532645
2025-10-13T18:35:32.647708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.647746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.647886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.647891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-13T18:35:32.647896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-13T18:35:32.647899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012832 bytes
2025-10-13T18:35:32.646701Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 0
2025-10-13T18:35:32.648210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-13T18:35:32.648245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-13T18:35:32.649071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.649080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.649154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-13T18:35:32.649223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-13T18:35:32.649279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-13T18:35:32.649684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-13T18:35:32.649717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-13T18:35:32.649721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-13T18:35:32.649745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.649749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.649766Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.649784Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 8 partNo 0 count 3 size 8295636
2025-10-13T18:35:32.649792Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 3 count 2 size 2970333
2025-10-13T18:35:32.649806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:32.649809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-13T18:35:32.649818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000002_00008?
2025-10-13T18:35:32.649831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:32.649835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.649858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.649932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.649936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.649951Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:35:32.649972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-13T18:35:32.650001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.650005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.650565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-13T18:35:32.650712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-13T18:35:32.650856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-13T18:35:32.650994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-13T18:35:32.651184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-13T18:35:32.651598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-13T18:35:32.651609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-13T18:35:32.651729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-13T18:35:32.651865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-13T18:35:32.652592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.652619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.652624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.653813Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 6 EndOffset 6 newEndOffset 8 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-10-13T18:35:32.653817Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 6 endOffset 8
2025-10-13T18:35:32.653835Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 6, endOffset# 8, WTime# 1760380532505, sizeLag# 4506416
2025-10-13T18:35:32.653837Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 1
2025-10-13T18:35:32.652118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:35:32.652124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:35:32.655217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.655527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.657807Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 4505940, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981652
2025-10-13T18:35:32.657983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 72 queued_in_partition_duration_ms: 19 }
2025-10-13T18:35:32.657995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 7
2025-10-13T18:35:32.658002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275215[B]
2025-10-13T18:35:32.655822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-13T18:35:32.655949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-13T18:35:32.658077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 69 queued_in_partition_duration_ms: 8 }
2025-10-13T18:35:32.656464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-13T18:35:32.658082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 8
2025-10-13T18:35:32.656481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.656622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-13T18:35:32.656761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-13T18:35:32.656897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-13T18:35:32.657038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-13T18:35:32.657249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-13T18:35:32.657746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6759623 count 3 nextOffset 7 batches 13
2025-10-13T18:35:32.657760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-13T18:35:32.657907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-13T18:35:32.658164Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-13T18:35:32.658172Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 4505940 to budget
2025-10-13T18:35:32.660281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 17 to 17
2025-10-13T18:35:32.660557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.660571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-13T18:35:32.660958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-13T18:35:32.661115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-13T18:35:32.661286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-13T18:35:32.661371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-13T18:35:32.661387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760380532660
2025-10-13T18:35:32.661679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-13T18:35:32.663437Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-13T18:35:32.663458Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.663954Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-13T18:35:32.663969Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.661777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,1 HeadOffset 3 endOffset 4 curOffset 8 d0000000000_00000000000000000007_00001_0000000001_00003| size 1741188 WTime 1760380532660
2025-10-13T18:35:32.664119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.664129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.664216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-13T18:35:32.664271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-13T18:35:32.664325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-13T18:35:32.664378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-13T18:35:32.664415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-13T18:35:32.664420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-13T18:35:32.664450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.664453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.664464Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.664479Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-13T18:35:32.664488Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 1 size 1741188
2025-10-13T18:35:32.664514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.664537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.664588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-13T18:35:32.665184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.666903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.667212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-13T18:35:32.465000Z WriteTime: 2025-10-13T18:35:32.504000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.668871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.668890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.669002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-13T18:35:32.669109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-13T18:35:32.669167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-13T18:35:32.669237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-13T18:35:32.669275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-13T18:35:32.669280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-13T18:35:32.669305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.669308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.669320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.669344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.669361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-13T18:35:32.669593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.671853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.671867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.671941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-13T18:35:32.671986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-13T18:35:32.672028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-13T18:35:32.672076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-13T18:35:32.672108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-13T18:35:32.672112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-13T18:35:32.672131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.672150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.673531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.676239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 18 to 18
2025-10-13T18:35:32.676615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.676631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-13T18:35:32.677765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528018[B] reached maximum (20971520[B])
2025-10-13T18:35:32.677816Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.678871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.679194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.682278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.682300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.682328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-13T18:35:32.690698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 8 count 3 size 8295636 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.690709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 2 size 2970333 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.690726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.690747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264553 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.690753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-13T18:35:32.690770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-13T18:35:32.690776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-13T18:35:32.690782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-13T18:35:32.690794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-13T18:35:32.690801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-13T18:35:32.690807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-13T18:35:32.690812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-13T18:35:32.690822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-13T18:35:32.690827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-13T18:35:32.690833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-13T18:35:32.690838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-13T18:35:32.690843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-13T18:35:32.690849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-13T18:35:32.690853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-13T18:35:32.690859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-13T18:35:32.690864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-13T18:35:32.690870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-13T18:35:32.690876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-13T18:35:32.690881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-13T18:35:32.690888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-13T18:35:32.690894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-13T18:35:32.690900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-13T18:35:32.690905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-13T18:35:32.690909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.690912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-13T18:35:32.690970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.690992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.691000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-13T18:35:32.691026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-13T18:35:32.691039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-13T18:35:32.691042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-13T18:35:32.691045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-13T18:35:32.691047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-13T18:35:32.691472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-13T18:35:32.691491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-13T18:35:32.691496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-13T18:35:32.691500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-13T18:35:32.691503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-13T18:35:32.691506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-13T18:35:32.692169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 4506428 count 2 nextOffset 15 batches 9
2025-10-13T18:35:32.692183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-13T18:35:32.692191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-13T18:35:32.692194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-13T18:35:32.692198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-13T18:35:32.692201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-13T18:35:32.692523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.692533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 3 parts 15 suffix '63' size 8295636
2025-10-13T18:35:32.692539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.692544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.692548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:35:32.692696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 6759626 count 3 nextOffset 16 batches 13
2025-10-13T18:35:32.692710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-13T18:35:32.692716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-13T18:35:32.692719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-13T18:35:32.692723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-13T18:35:32.709096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 17 partNo 3 result is x0000000000_00000000000000000013_00000_0000000003_00015? size 8295638
2025-10-13T18:35:32.709129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-13T18:35:32.709148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000013_00000_0000000003_00015? new key d0000000000_00000000000000000013_00000_0000000003_00015? size 8295638 WTime 1760380532708
2025-10-13T18:35:32.709305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 1 NewHead: Offset 16 PartNo 3 PackedSize 717145 count 1 nextOffset 17 batches 2
2025-10-13T18:35:32.709319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.709444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,1 HeadOffset 13 endOffset 13 curOffset 17 d0000000000_00000000000000000016_00003_0000000001_00001? size 717135 WTime 1760380532709
2025-10-13T18:35:32.709571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.709651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-13T18:35:32.709673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-13T18:35:32.709692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-13T18:35:32.709705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-13T18:35:32.709719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-13T18:35:32.709734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 1 size 2253219 cause it's been evicted from L2. Actual L1 size: 9
2025-10-13T18:35:32.709737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 2 size 2253219 cause it's been evicted from L2. Actual L1 size: 8
2025-10-13T18:35:32.709740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 2253219 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:32.709744Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.709761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-13T18:35:32.709766Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.709778Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 3 size 8295638
2025-10-13T18:35:32.709785Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 3 count 1 size 717135
2025-10-13T18:35:32.709792Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-13T18:35:32.709797Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-13T18:35:32.709799Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-13T18:35:32.709801Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00004?(+) to d0000000000_00000000000000000003_00000_0000000001_00004?(+)
2025-10-13T18:35:32.710069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.710098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.710104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.710108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.710112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.710116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.713291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.713312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.713395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-13T18:35:32.713447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-13T18:35:32.713506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-13T18:35:32.713563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-13T18:35:32.713593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-13T18:35:32.713597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-13T18:35:32.713622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.713647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.716048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 66 queued_in_partition_duration_ms: 51 }
2025-10-13T18:35:32.716066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 9
2025-10-13T18:35:32.716072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275217[B]
2025-10-13T18:35:32.716190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 66 queued_in_partition_duration_ms: 42 }
2025-10-13T18:35:32.716195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 10
2025-10-13T18:35:32.716226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 63 queued_in_partition_duration_ms: 38 }
2025-10-13T18:35:32.716230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 11
2025-10-13T18:35:32.716252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 62 queued_in_partition_duration_ms: 14 }
2025-10-13T18:35:32.716255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 12
2025-10-13T18:35:32.716277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 24 }
2025-10-13T18:35:32.716281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 13
2025-10-13T18:35:32.716648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 19 to 19
2025-10-13T18:35:32.716909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.716923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-13T18:35:32.718443Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-13T18:35:32.718466Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.718476Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505940, ReadSizeServerDelta = -3981652
2025-10-13T18:35:32.718562Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.718574Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-13T18:35:32.473000Z WriteTime: 2025-10-13T18:35:32.505000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.720460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.720481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 1 size 1741188 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.720499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.720869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.720890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000008_00000_0000000003_00015?
2025-10-13T18:35:32.720893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00003_0000000002_00005?
2025-10-13T18:35:32.720897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11265969 bytes
2025-10-13T18:35:32.720907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:32.720910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000008_00000_0000000003_00015?
2025-10-13T18:35:32.720922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00003_0000000002_00005?
2025-10-13T18:35:32.720936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:32.720949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 8 partno 0 count 3 parts_count 15 source 1 size 8295636 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.720952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.720959Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:35:32.720989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.721002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.721168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-13T18:35:32.721354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-13T18:35:32.721517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-13T18:35:32.721688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-13T18:35:32.721957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-13T18:35:32.722468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 2253229 count 1 nextOffset 9 batches 5
2025-10-13T18:35:32.722496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-13T18:35:32.722665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-13T18:35:32.722842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-13T18:35:32.723016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-13T18:35:32.723255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-13T18:35:32.723848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 8 PartNo 0 PackedSize 4506426 count 2 nextOffset 10 batches 9
2025-10-13T18:35:32.723869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-13T18:35:32.724096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-13T18:35:32.724111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-13T18:35:32.724115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:32.724121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 1 parts 3 suffix '124' size 1741188
2025-10-13T18:35:32.724135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:35:32.724139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 3 count 2 parts 5 suffix '63'
2025-10-13T18:35:32.724229Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505940 } }
2025-10-13T18:35:32.724286Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# 20da15e7-16d946ab-fabbea95-65860296
2025-10-13T18:35:32.724309Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 64c57744-4b80890c-d6c43a98-d07a0860, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.724339Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 6 EndOffset 8 ClientCommitOffset 0 committedOffset 0 Guid 64c57744-4b80890c-d6c43a98-d07a0860
2025-10-13T18:35:32.724749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.725106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.724451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-13T18:35:32.724812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-13T18:35:32.725014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-13T18:35:32.725117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-13T18:35:32.732195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 20 to 20
2025-10-13T18:35:32.732505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.732521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-13T18:35:32.733911Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.733846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295601
2025-10-13T18:35:32.733869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295601 WTime 1760380532732
2025-10-13T18:35:32.733905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-13T18:35:32.735120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-13T18:35:32.735126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-13T18:35:32.735128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-13T18:35:32.735136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.735285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-13T18:35:32.735514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-13T18:35:32.736449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-13T18:35:32.736462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-13T18:35:32.736612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-13T18:35:32.736756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-13T18:35:32.736915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-13T18:35:32.737010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-13T18:35:32.737591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-13T18:35:32.737674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,3 HeadOffset 7 endOffset 8 curOffset 13 d0000000000_00000000000000000010_00004_0000000003_00008| size 4711504 WTime 1760380532737
2025-10-13T18:35:32.739959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 2253219 cause it's been evicted from L2. Actual L1 size: 8
2025-10-13T18:35:32.739965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:32.739971Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.740027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.740053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.740074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.740077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.740104Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.740123Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295601
2025-10-13T18:35:32.740133Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 3 size 4711504
2025-10-13T18:35:32.740338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 21 to 21
2025-10-13T18:35:32.740614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.740628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-13T18:35:32.740401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-13T18:35:32.740433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 6 count 2 size 524288 endOffset 13 max time lag 0ms effective offset 6
2025-10-13T18:35:32.740451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 0 count 1 last offset 3, current partition end offset: 13
2025-10-13T18:35:32.740766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-13T18:35:32.740790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.740799Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-10-13T18:35:32.740829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.740952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-13T18:35:32.741874Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.742700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 1 size 717094 from pos 1 cbcount 2
2025-10-13T18:35:32.742889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.743056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.743258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.743334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.743502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.740724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.746549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 22 to 22
2025-10-13T18:35:32.746836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.746848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-13T18:35:32.744517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.744851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.744438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.744453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.744529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-13T18:35:32.744585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-13T18:35:32.744648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-13T18:35:32.744703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-13T18:35:32.744729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-13T18:35:32.744734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-13T18:35:32.744830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 6
2025-10-13T18:35:32.744847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.744867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.744892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.744896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 717135 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.745723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.745743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.745749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-13T18:35:32.745763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-13T18:35:32.745769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-13T18:35:32.745776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-13T18:35:32.745785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-13T18:35:32.745792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-13T18:35:32.745798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-13T18:35:32.745805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-13T18:35:32.745811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-13T18:35:32.745819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-13T18:35:32.745826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-13T18:35:32.745832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-13T18:35:32.745837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-13T18:35:32.745844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-13T18:35:32.745851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-13T18:35:32.745858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-13T18:35:32.745866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-13T18:35:32.745875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-13T18:35:32.745882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-13T18:35:32.745888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.745892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-13T18:35:32.745922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.745935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.745937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:35:32.745956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-13T18:35:32.745964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-13T18:35:32.745968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-13T18:35:32.745973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-13T18:35:32.745976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-13T18:35:32.746417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-13T18:35:32.746435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-13T18:35:32.746440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-13T18:35:32.746444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-13T18:35:32.746448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-13T18:35:32.746452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-13T18:35:32.747058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-13T18:35:32.747068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.747331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,2 HeadOffset 17 endOffset 17 curOffset 19 d0000000000_00000000000000000017_00000_0000000002_00008? size 4506418 WTime 1760380532747
2025-10-13T18:35:32.747439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-13T18:35:32.747447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:35:32.747453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-13T18:35:32.747459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:32.747464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:32.748584Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.750025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.750062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-13T18:35:32.750068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.750105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-13T18:35:32.750506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.750551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.750559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.750564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.750757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.750283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-13T18:35:32.750306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-13T18:35:32.750324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-13T18:35:32.750334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 717134 cause it's been evicted from L2. Actual L1 size: 8
2025-10-13T18:35:32.750337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 6 size 4506416 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:32.750342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 4 size 4506416 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.750345Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.750366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.750368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.750374Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.750395Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 2 size 4506418
2025-10-13T18:35:32.750400Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000002_00008?(+) to d0000000000_00000000000000000004_00000_0000000002_00008?(+)
2025-10-13T18:35:32.750402Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000002_00008?(+) to d0000000000_00000000000000000006_00000_0000000002_00008?(+)
2025-10-13T18:35:32.750404Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000001_00001|(+) to d0000000000_00000000000000000003_00003_0000000001_00001|(+)
2025-10-13T18:35:32.750470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-13T18:35:32.750501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 1 size 26214400 endOffset 17 max time lag 0ms effective offset 7
2025-10-13T18:35:32.750505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 0 blobs, size 0 count 0 last offset 7, current partition end offset: 17
2025-10-13T18:35:32.751211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. All data is from uncompacted head.
2025-10-13T18:35:32.751218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-13T18:35:32.751253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 6
2025-10-13T18:35:32.753601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 50 queued_in_partition_duration_ms: 43 }
2025-10-13T18:35:32.753616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 14
2025-10-13T18:35:32.753680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 49 queued_in_partition_duration_ms: 27 }
2025-10-13T18:35:32.753683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 15
2025-10-13T18:35:32.754047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.754439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 23 to 23
2025-10-13T18:35:32.754361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.753836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.753850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.753932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-13T18:35:32.753996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-13T18:35:32.754056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-13T18:35:32.754113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-13T18:35:32.754135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-13T18:35:32.754141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-13T18:35:32.754160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.754178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.754690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.754705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-13T18:35:32.755311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.755324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.755341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-13T18:35:32.755985Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.757852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 49 queued_in_partition_duration_ms: 23 }
2025-10-13T18:35:32.757865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 16
2025-10-13T18:35:32.757928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 48 queued_in_partition_duration_ms: 20 }
2025-10-13T18:35:32.757932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 17
2025-10-13T18:35:32.759006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 24 to 24
2025-10-13T18:35:32.758741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.758753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.758822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-13T18:35:32.758875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-13T18:35:32.758927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-13T18:35:32.758985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-13T18:35:32.759040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-13T18:35:32.759340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.759365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-13T18:35:32.755981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.758188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.758508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.758873Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 17 Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532551 CreateTimestampMS: 1760380532485 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532554 CreateTimestampMS: 1760380532504 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 26116143 RealReadOffset: 7 WaitQuotaTimeMs: 0 EndOffset: 17 StartOffset: 0 } Cookie: 6 }
2025-10-13T18:35:32.759388Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 8 endOffset 17
2025-10-13T18:35:32.759409Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 ReadOffset 8 ReadGuid 64c57744-4b80890c-d6c43a98-d07a0860 has messages 1
2025-10-13T18:35:32.759441Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 8, endOffset# 17, WTime# 1760380532554, sizeLag# 26116143
2025-10-13T18:35:32.759445Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:32.759459Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 64c57744-4b80890c-d6c43a98-d07a0860, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505940
2025-10-13T18:35:32.759468Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 64c57744-4b80890c-d6c43a98-d07a0860
2025-10-13T18:35:32.760874Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.762303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.759044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-13T18:35:32.759081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.759084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.759092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.759105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.759258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-13T18:35:32.762435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.762440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 3 size 4711504 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.762465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 1 parts 3 suffix '124' size 1741188
2025-10-13T18:35:32.762468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 8 partno 0 count 3 parts 15 suffix '63' size 8295636
2025-10-13T18:35:32.762471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.762472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-13T18:35:32.762474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-10-13T18:35:32.763759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.763766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000003_00015?
2025-10-13T18:35:32.763769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00003_0000000001_00001?
2025-10-13T18:35:32.763772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-13T18:35:32.763784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 1741188 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:32.763787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 8 size 8295636 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.763791Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.763896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:32.763906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000003_00015?
2025-10-13T18:35:32.763935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00003_0000000001_00001?
2025-10-13T18:35:32.763948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:32.764116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.764408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.764605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 25 to 25
2025-10-13T18:35:32.764852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.764861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-13T18:35:32.764045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.764057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.764062Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:35:32.764087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.764091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.764110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:35:32.764112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 3 count 1 parts 1 suffix '63'
2025-10-13T18:35:32.764539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-13T18:35:32.764710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-13T18:35:32.764889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-13T18:35:32.765533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-13T18:35:32.766851Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.766738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-13T18:35:32.768419Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:32.769910Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 4505940, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981652
2025-10-13T18:35:32.770017Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-13T18:35:32.770023Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 4505940 to budget
2025-10-13T18:35:32.770761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 26 to 26
2025-10-13T18:35:32.771068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.771080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-13T18:35:32.767486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-13T18:35:32.767500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-13T18:35:32.768041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-13T18:35:32.768193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-13T18:35:32.772991Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (6-6)
2025-10-13T18:35:32.773011Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-13T18:35:32.485000Z WriteTime: 2025-10-13T18:35:32.551000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.772828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988760
2025-10-13T18:35:32.772992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-13T18:35:32.773221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-13T18:35:32.773236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988760 WTime 1760380532771
2025-10-13T18:35:32.773466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-13T18:35:32.773477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-13T18:35:32.775983Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-13T18:35:32.776009Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.773637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-13T18:35:32.774069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-13T18:35:32.774227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-13T18:35:32.774377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-13T18:35:32.774862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-13T18:35:32.775328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-13T18:35:32.775333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-13T18:35:32.775336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-13T18:35:32.775344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.775469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-13T18:35:32.775528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-13T18:35:32.777984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 27 to 27
2025-10-13T18:35:32.778291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.778305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-13T18:35:32.779455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:32.779505Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.776562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-13T18:35:32.776666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,3 HeadOffset 10 endOffset 13 curOffset 17 d0000000000_00000000000000000014_00002_0000000003_00010| size 5735558 WTime 1760380532775
2025-10-13T18:35:32.778631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.778639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.778721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-13T18:35:32.778783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-13T18:35:32.778848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-13T18:35:32.779030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-13T18:35:32.779052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-13T18:35:32.779058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-13T18:35:32.779082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.779084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.779192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.779198Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.779211Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988760
2025-10-13T18:35:32.779219Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 3 size 5735558
2025-10-13T18:35:32.779227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.779245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.779287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 2 size 4506418 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.779334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-13T18:35:32.779341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.779352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 11 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:35:32.779356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:32.779358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.779359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:32.779364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-13T18:35:32.779376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-13T18:35:32.779381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-13T18:35:32.779387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-13T18:35:32.779399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-13T18:35:32.779406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-13T18:35:32.779412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-13T18:35:32.779419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-13T18:35:32.779426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-13T18:35:32.779433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.779439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-13T18:35:32.779479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.779493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.779495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-13T18:35:32.779511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-13T18:35:32.779519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-13T18:35:32.779523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-13T18:35:32.779527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-13T18:35:32.779531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-13T18:35:32.780278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2253230 count 1 nextOffset 20 batches 5
2025-10-13T18:35:32.780301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-13T18:35:32.780307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-13T18:35:32.780311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-13T18:35:32.780314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-13T18:35:32.780317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-13T18:35:32.780888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4506428 count 2 nextOffset 21 batches 9
2025-10-13T18:35:32.780902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-13T18:35:32.780908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-13T18:35:32.780911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-13T18:35:32.780915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-13T18:35:32.780918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-13T18:35:32.779977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.781950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.782270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.781650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 6759626 count 3 nextOffset 22 batches 13
2025-10-13T18:35:32.781667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.781763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 19,3 HeadOffset 19 endOffset 19 curOffset 22 d0000000000_00000000000000000019_00000_0000000003_00012? size 6759616 WTime 1760380532779
2025-10-13T18:35:32.785059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.785114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.785119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 11 size 2970333 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:32.785123Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.785162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-13T18:35:32.785184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-13T18:35:32.787707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.787760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.788154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 34 queued_in_partition_duration_ms: 28 }
2025-10-13T18:35:32.788168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 18
2025-10-13T18:35:32.788174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:32.787752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.787762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.787833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-13T18:35:32.787886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-13T18:35:32.787958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-13T18:35:32.788022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-13T18:35:32.788050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-13T18:35:32.788054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-13T18:35:32.788091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.788094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.788102Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.788115Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 0 count 3 size 6759616
2025-10-13T18:35:32.788124Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000008_00000_0000000003_00015?(+) to d0000000000_00000000000000000008_00000_0000000003_00015?(+)
2025-10-13T18:35:32.788127Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00003_0000000002_00005?(+) to d0000000000_00000000000000000011_00003_0000000002_00005?(+)
2025-10-13T18:35:32.788130Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000001_00003|(+) to d0000000000_00000000000000000007_00001_0000000001_00003|(+)
2025-10-13T18:35:32.788167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.788183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.788236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-13T18:35:32.788495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 28 to 28
2025-10-13T18:35:32.788782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.788793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-13T18:35:32.790628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:32.790934Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (7-7)
2025-10-13T18:35:32.790953Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.790966Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505940, ReadSizeServerDelta = -3981652
2025-10-13T18:35:32.791014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 34 }
2025-10-13T18:35:32.791028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 19
2025-10-13T18:35:32.791038Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.791049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:32.791050Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-13T18:35:32.504000Z WriteTime: 2025-10-13T18:35:32.554000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49910", "logtype": "unknown", "_ip": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.793240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.793252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.793288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 8 count 10 size 524288 endOffset 19 max time lag 0ms effective offset 8
2025-10-13T18:35:32.793316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 0 count 2 last offset 7, current partition end offset: 19
2025-10-13T18:35:32.794112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-10-13T18:35:32.794138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295601 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.794154Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-10-13T18:35:32.794175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-13T18:35:32.794177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:32.794932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.795108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.795275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.795991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.796232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-13T18:35:32.796395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.796561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.796727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.796812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-13T18:35:32.796908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 29 to 29
2025-10-13T18:35:32.797188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.797212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-13T18:35:32.798137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-13T18:35:32.791967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.792791Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505940 } }
2025-10-13T18:35:32.792851Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# 6193b2fb-32f861b1-11e3e752-a68fcfd9
2025-10-13T18:35:32.792874Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 823a5784-7b5f3be2-f48840d7-dac7a762, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.792901Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 8 EndOffset 17 ClientCommitOffset 0 committedOffset 0 Guid 823a5784-7b5f3be2-f48840d7-dac7a762
2025-10-13T18:35:32.798693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.798983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.799748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.799771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.799869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-13T18:35:32.799968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-13T18:35:32.800048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-13T18:35:32.800203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:32.800217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-13T18:35:32.800254Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.800313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-13T18:35:32.800327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-13T18:35:32.800396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 8
2025-10-13T18:35:32.800437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.800448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.800458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.800485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.802645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-13T18:35:32.807047Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 19 Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532624 CreateTimestampMS: 1760380532512 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760380532624 CreateTimestampMS: 1760380532533 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 10754169 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 19 StartOffset: 0 } Cookie: 8 }
2025-10-13T18:35:32.807579Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 19
2025-10-13T18:35:32.807593Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 19 ReadOffset 10 ReadGuid 823a5784-7b5f3be2-f48840d7-dac7a762 has messages 1
2025-10-13T18:35:32.807639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.808699Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 19, WTime# 1760380532624, sizeLag# 10754169
2025-10-13T18:35:32.808702Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:32.808716Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 823a5784-7b5f3be2-f48840d7-dac7a762, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505820
2025-10-13T18:35:32.808725Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 823a5784-7b5f3be2-f48840d7-dac7a762
2025-10-13T18:35:32.811261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.811544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.810204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.810219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.810303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-13T18:35:32.810374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-13T18:35:32.810445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-13T18:35:32.810500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-13T18:35:32.810537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-13T18:35:32.810542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-13T18:35:32.810619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.810639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.810653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.810657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 5735558 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.810676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.810701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-10-13T18:35:32.810707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-13T18:35:32.810713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:32.810721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-10-13T18:35:32.811558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.811563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.811574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 4711504 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.811578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 13 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:32.811582Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.811753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.811760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.811780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-13T18:35:32.812626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.813268Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:32.814559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.814977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.815687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.815707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.815801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-13T18:35:32.815876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-13T18:35:32.815979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-13T18:35:32.816060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-13T18:35:32.816113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-13T18:35:32.816122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-13T18:35:32.816149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.816156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.816165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.816192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.816206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-13T18:35:32.816687Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 4505820, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981532
2025-10-13T18:35:32.816807Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-13T18:35:32.816816Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 4505820 to budget
2025-10-13T18:35:32.816796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.818970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.819320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.819942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.819959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.820035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-13T18:35:32.820102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-13T18:35:32.820167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-13T18:35:32.820235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-13T18:35:32.820294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-13T18:35:32.820299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-13T18:35:32.820394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.820399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.820408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.820427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.820466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 19 count 3 size 6759616 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.820488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.820506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.820511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-13T18:35:32.820524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-13T18:35:32.820530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-13T18:35:32.820537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-13T18:35:32.820547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-13T18:35:32.820554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 16 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:32.820558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-13T18:35:32.820562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:35:32.820566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-13T18:35:32.820568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-13T18:35:32.820574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-13T18:35:32.820581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-13T18:35:32.820588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-13T18:35:32.820594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-13T18:35:32.820599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-13T18:35:32.820606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-13T18:35:32.820616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.820620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-13T18:35:32.820654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.820673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.820675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-13T18:35:32.820697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-13T18:35:32.820709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-13T18:35:32.820713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-13T18:35:32.820716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-13T18:35:32.820720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-13T18:35:32.821232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-13T18:35:32.821252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-13T18:35:32.821258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-13T18:35:32.821261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-13T18:35:32.821265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-13T18:35:32.821269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-13T18:35:32.821923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-13T18:35:32.821939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-13T18:35:32.821947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-13T18:35:32.821951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-13T18:35:32.821955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-13T18:35:32.821958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-13T18:35:32.822589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-13T18:35:32.822603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-13T18:35:32.822609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-13T18:35:32.822612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-13T18:35:32.822616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-13T18:35:32.825981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 26 partNo 3 result is x0000000000_00000000000000000022_00000_0000000003_00015? size 8295638
2025-10-13T18:35:32.826003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-13T18:35:32.826020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000022_00000_0000000003_00015? new key d0000000000_00000000000000000022_00000_0000000003_00015? size 8295638 WTime 1760380532825
2025-10-13T18:35:32.826214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 3 PackedSize 717145 count 1 nextOffset 26 batches 2
2025-10-13T18:35:32.826232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-13T18:35:32.826238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-13T18:35:32.826243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-13T18:35:32.826246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-13T18:35:32.826250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-13T18:35:32.827434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 3 PackedSize 2970343 count 2 nextOffset 27 batches 6
2025-10-13T18:35:32.827459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.827602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 22 endOffset 22 curOffset 27 d0000000000_00000000000000000025_00003_0000000002_00005? size 2970333 WTime 1760380532827
2025-10-13T18:35:32.828103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000002_00008?
2025-10-13T18:35:32.828116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00000_0000000003_00012?
2025-10-13T18:35:32.828120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-13T18:35:32.828152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-13T18:35:32.828380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.828430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.828441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.828449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.830925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 23 }
2025-10-13T18:35:32.830948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 20
2025-10-13T18:35:32.830955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:32.831012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.831108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 39 queued_in_partition_duration_ms: 22 }
2025-10-13T18:35:32.831129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 21
2025-10-13T18:35:32.831432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 30 to 30
2025-10-13T18:35:32.828196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-13T18:35:32.828220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 16 size 717135 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:32.828224Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.828238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-13T18:35:32.828256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-13T18:35:32.828380Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.828393Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 3 size 8295638
2025-10-13T18:35:32.828403Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 3 count 2 size 2970333
2025-10-13T18:35:32.828408Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000003_00015?(+) to d0000000000_00000000000000000013_00000_0000000003_00015?(+)
2025-10-13T18:35:32.828410Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00003_0000000001_00001?(+) to d0000000000_00000000000000000016_00003_0000000001_00001?(+)
2025-10-13T18:35:32.828412Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000003_00008|(+) to d0000000000_00000000000000000010_00004_0000000003_00008|(+)
2025-10-13T18:35:32.828420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:32.828422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000002_00008?
2025-10-13T18:35:32.828431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000019_00000_0000000003_00012?
2025-10-13T18:35:32.828442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:32.828501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.828505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 19 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.828513Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:35:32.828536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:35:32.828539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 3 parts 12 suffix '63'
2025-10-13T18:35:32.828551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.828555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.828733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-13T18:35:32.828915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-13T18:35:32.829098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-13T18:35:32.829292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-13T18:35:32.829672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-13T18:35:32.830117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-13T18:35:32.830126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-13T18:35:32.831700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.831713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-13T18:35:32.832406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.833298Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (8-8)
2025-10-13T18:35:32.833320Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.834148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 39 queued_in_partition_duration_ms: 4 }
2025-10-13T18:35:32.834161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 22
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-13T18:35:32.512000Z WriteTime: 2025-10-13T18:35:32.624000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.834855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988778
2025-10-13T18:35:32.835061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-13T18:35:32.836072Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-13T18:35:32.835225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-13T18:35:32.835397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-13T18:35:32.836090Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.835498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-13T18:35:32.835510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988778 WTime 1760380532835
2025-10-13T18:35:32.836226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-13T18:35:32.836244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.840038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 31 to 31
2025-10-13T18:35:32.836394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-13T18:35:32.836552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-13T18:35:32.836703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-13T18:35:32.836857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-13T18:35:32.837094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-13T18:35:32.837766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-13T18:35:32.837776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-13T18:35:32.837918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-13T18:35:32.838075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-13T18:35:32.838234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-13T18:35:32.838473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-13T18:35:32.839074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-13T18:35:32.839084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-13T18:35:32.839247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-13T18:35:32.839412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-13T18:35:32.839575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-13T18:35:32.840324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.840338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-13T18:35:32.841959Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.846956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 32 to 32
2025-10-13T18:35:32.847257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.847269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-13T18:35:32.848878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:32.849225Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (9-9)
2025-10-13T18:35:32.849244Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-13T18:35:32.849253Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505820, ReadSizeServerDelta = -3981532
2025-10-13T18:35:32.849335Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:32.849347Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-13T18:35:32.533000Z WriteTime: 2025-10-13T18:35:32.624000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.850442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-10-13T18:35:32.850548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-13T18:35:32.850566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1760380532850
2025-10-13T18:35:32.850696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-13T18:35:32.850777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 14 endOffset 17 curOffset 22 d0000000000_00000000000000000021_00003_0000000001_00001| size 717135 WTime 1760380532850
2025-10-13T18:35:32.851838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.851855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.852100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-13T18:35:32.852171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-13T18:35:32.852242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-13T18:35:32.852311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-13T18:35:32.852347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-13T18:35:32.852354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-13T18:35:32.852390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.852394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.852426Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.852445Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988778
2025-10-13T18:35:32.852453Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-13T18:35:32.852461Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 1 size 717135
2025-10-13T18:35:32.852471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.852495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.852501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-13T18:35:32.853260Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505820 } }
2025-10-13T18:35:32.853362Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# f0b1ebc4-bb806996-7be5a2ec-1a827e41
2025-10-13T18:35:32.853386Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 470eb91c-4dbc1efc-869c6b1a-8d9cc158, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:32.853420Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 19 ClientCommitOffset 0 committedOffset 0 Guid 470eb91c-4dbc1efc-869c6b1a-8d9cc158
2025-10-13T18:35:32.853899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.853911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.853944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 10 size 524288 endOffset 22 max time lag 0ms effective offset 10
2025-10-13T18:35:32.853980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 2 blobs, size 7988760 count 4 last offset 10, current partition end offset: 22
2025-10-13T18:35:32.854302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-10-13T18:35:32.854325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 1 count 3 parts_count 15 source 1 size 8295601 accessed 1 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.854329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 4 count 4 parts_count 14 source 1 size 7988760 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.854341Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 2 blobs are from cache.
2025-10-13T18:35:32.854371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-13T18:35:32.856898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-13T18:35:32.857215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:35:32.857366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.857540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0'
2025-10-13T18:35:32.857545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0'
2025-10-13T18:35:32.858783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.858940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.859157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:35:32.859313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.859471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.859629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.859721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:35:32.859895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:32.860066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.860234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.860391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:32.860495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:35:32.860768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-13T18:35:32.860911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-13T18:35:32.860964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.860968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 2970333 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.861018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-10-13T18:35:32.861025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:32.861029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:32.861036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-13T18:35:32.861047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:35:32.864610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.864638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.864649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-13T18:35:32.864660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-13T18:35:32.864665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-13T18:35:32.864670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-13T18:35:32.864678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-13T18:35:32.864683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-13T18:35:32.864689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-13T18:35:32.864693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-13T18:35:32.864699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-13T18:35:32.864704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-13T18:35:32.864710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-13T18:35:32.864715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-13T18:35:32.864718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-13T18:35:32.864724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-13T18:35:32.864728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-13T18:35:32.864734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-13T18:35:32.864739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-13T18:35:32.864745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-13T18:35:32.864750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-13T18:35:32.864754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-13T18:35:32.864759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-13T18:35:32.864763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-13T18:35:32.864766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-13T18:35:32.864770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-13T18:35:32.864776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.864779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-13T18:35:32.864810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.864821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.864823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:32.864840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-13T18:35:32.864848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-13T18:35:32.864851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-13T18:35:32.864854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-13T18:35:32.864857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-13T18:35:32.865336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-13T18:35:32.865350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.865476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 27,1 HeadOffset 27 endOffset 27 curOffset 28 d0000000000_00000000000000000027_00000_0000000001_00004? size 2253220 WTime 1760380532864
2025-10-13T18:35:32.866450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.866466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 19 size 6759616 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.866469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 17 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:32.866471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 5735558 cause it's been evicted from L2. Actual L1 size: 4
2025-10-13T18:35:32.866475Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.866618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-13T18:35:32.866635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-13T18:35:32.866647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-13T18:35:32.866658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-13T18:35:32.866846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-13T18:35:32.866851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-13T18:35:32.866855Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.866864Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 1 size 2253220
2025-10-13T18:35:32.873245Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 22 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532627 CreateTimestampMS: 1760380532540 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532627 CreateTimestampMS: 1760380532546 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532644 CreateTimestampMS: 1760380532576 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532690 CreateTimestampMS: 1760380532582 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 18446744073708527998 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 22 StartOffset: 0 } Cookie: 10 }
2025-10-13T18:35:32.875969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.876007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.876023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.876041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.876056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.876063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.877032Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 22
2025-10-13T18:35:32.877061Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 22 ReadOffset 14 ReadGuid 470eb91c-4dbc1efc-869c6b1a-8d9cc158 has messages 1
2025-10-13T18:35:32.877116Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 22, WTime# 1760380532690, sizeLag# 18446744073708527998
2025-10-13T18:35:32.877122Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:32.877138Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 470eb91c-4dbc1efc-869c6b1a-8d9cc158, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011748
2025-10-13T18:35:32.877151Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 470eb91c-4dbc1efc-869c6b1a-8d9cc158
2025-10-13T18:35:32.880331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 32 }
2025-10-13T18:35:32.880351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 23
2025-10-13T18:35:32.880357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:32.880443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 20 }
2025-10-13T18:35:32.880447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 24
2025-10-13T18:35:32.880470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 43 queued_in_partition_duration_ms: 12 }
2025-10-13T18:35:32.880473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 25
2025-10-13T18:35:32.880493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 42 queued_in_partition_duration_ms: 6 }
2025-10-13T18:35:32.880496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 26
2025-10-13T18:35:32.880516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 6 }
2025-10-13T18:35:32.880522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 27
2025-10-13T18:35:32.880867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 33 to 33
2025-10-13T18:35:32.881139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.881153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-13T18:35:32.883395Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.883305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.883713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.884113Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:32.886034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.886955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.886967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.887052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-13T18:35:32.887679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-13T18:35:32.887750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-13T18:35:32.887814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-13T18:35:32.887865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-13T18:35:32.887871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-13T18:35:32.887970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.887973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.887983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.888006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.888021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-13T18:35:32.889243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 34 to 34
2025-10-13T18:35:32.889565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.889583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-13T18:35:32.889991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.891591Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.892709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.893259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.893366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.893381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.893450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-13T18:35:32.893598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-13T18:35:32.893658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-13T18:35:32.893720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-13T18:35:32.893784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-13T18:35:32.893791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-13T18:35:32.893821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.893825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.893837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.893861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.893875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-13T18:35:32.893988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.895437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 35 to 35
2025-10-13T18:35:32.895713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.895729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-13T18:35:32.895787Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.896068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.896406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.897762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.897777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.897864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-13T18:35:32.897930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-13T18:35:32.898001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-13T18:35:32.898071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-13T18:35:32.898137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-13T18:35:32.898141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-13T18:35:32.898168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.898172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.898197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.898218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.898375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-13T18:35:32.898802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.900423Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 9011748, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487460
2025-10-13T18:35:32.900519Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-13T18:35:32.900529Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 9011748 to budget
2025-10-13T18:35:32.900991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.901354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.902341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 36 to 36
2025-10-13T18:35:32.902617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.902627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-13T18:35:32.903832Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-13T18:35:32.903854Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:32.903914Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-13T18:35:32.903951Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.902613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.902625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.902731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-13T18:35:32.902792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-13T18:35:32.902862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-13T18:35:32.902922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-13T18:35:32.902974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-13T18:35:32.902981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-13T18:35:32.903007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.903010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.903074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.903090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.903108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.903111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.903115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 717135 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.903134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-13T18:35:32.903143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.903320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.903325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000003_00015?
2025-10-13T18:35:32.903326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00003_0000000002_00005?
2025-10-13T18:35:32.903328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11265971 bytes
2025-10-13T18:35:32.903335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:32.903337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000003_00015?
2025-10-13T18:35:32.903343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00003_0000000002_00005?
2025-10-13T18:35:32.903351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:32.903357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 22 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.903360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.903365Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-13T18:35:32.903387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.903392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.903522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-13T18:35:32.903671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-13T18:35:32.903817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-13T18:35:32.903982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-13T18:35:32.903988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:32.903994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-13T18:35:32.903997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-13T18:35:32.904000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-13T18:35:32.904013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:35:32.904017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 3 count 2 parts 5 suffix '63'
2025-10-13T18:35:32.904202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-13T18:35:32.904397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-13T18:35:32.540000Z WriteTime: 2025-10-13T18:35:32.627000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "logtype": "unknown", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.904467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-13T18:35:32.906598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.907054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.905683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-13T18:35:32.905697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-13T18:35:32.905860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-13T18:35:32.905998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-13T18:35:32.906129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-13T18:35:32.906365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-13T18:35:32.907143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 4506428 count 2 nextOffset 24 batches 9
2025-10-13T18:35:32.907153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-13T18:35:32.907278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-13T18:35:32.907404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-13T18:35:32.907532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-13T18:35:32.907616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-13T18:35:32.908144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 6759626 count 3 nextOffset 25 batches 13
2025-10-13T18:35:32.908532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 37 to 37
2025-10-13T18:35:32.908630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-13T18:35:32.908642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-13T18:35:32.908825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.908838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-13T18:35:32.910336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:32.910387Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.914779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988782
2025-10-13T18:35:32.914799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-13T18:35:32.914812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.914982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-13T18:35:32.915262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-13T18:35:32.915285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988782 WTime 1760380532915
2025-10-13T18:35:32.915627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-13T18:35:32.915647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-13T18:35:32.915793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-13T18:35:32.915971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-13T18:35:32.916132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-13T18:35:32.916203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-13T18:35:32.916701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-13T18:35:32.916772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 21 endOffset 22 curOffset 27 d0000000000_00000000000000000025_00001_0000000002_00007| size 3994387 WTime 1760380532916
2025-10-13T18:35:32.919786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.919795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:32.919800Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.920755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.920764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.920842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-13T18:35:32.920898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-13T18:35:32.920957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-13T18:35:32.921010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-13T18:35:32.921048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-13T18:35:32.921054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-13T18:35:32.921081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.921083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.921091Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.921104Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988782
2025-10-13T18:35:32.921111Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 2 size 3994387
2025-10-13T18:35:32.921306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.921332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.921376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-13T18:35:32.923466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.926402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.926758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.927979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.927994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.928070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-13T18:35:32.928127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-13T18:35:32.928189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-13T18:35:32.928252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-13T18:35:32.928295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-13T18:35:32.928299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-13T18:35:32.928322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.928325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.928343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 1 size 2253220 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.928366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.928389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.928396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.928415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.928423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.928431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-13T18:35:32.928434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.928442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-13T18:35:32.928443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.928447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-13T18:35:32.928449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.928451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-13T18:35:32.928456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.928459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-13T18:35:32.928488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.928505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.928506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (30)
2025-10-13T18:35:32.928521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-13T18:35:32.928529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-13T18:35:32.928532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-13T18:35:32.928534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-13T18:35:32.928536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-13T18:35:32.928956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 0 PackedSize 2253230 count 1 nextOffset 29 batches 5
2025-10-13T18:35:32.928971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-13T18:35:32.928976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-13T18:35:32.928978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-13T18:35:32.928980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-13T18:35:32.928982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-13T18:35:32.929544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 0 PackedSize 4506428 count 2 nextOffset 30 batches 9
2025-10-13T18:35:32.929557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-13T18:35:32.929561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-13T18:35:32.929564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-13T18:35:32.929566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-13T18:35:32.929569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-13T18:35:32.930066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 0 PackedSize 6759626 count 3 nextOffset 31 batches 13
2025-10-13T18:35:32.930075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-13T18:35:32.930081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-13T18:35:32.930086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-13T18:35:32.930089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-13T18:35:32.932202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:32.942098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 32 partNo 3 result is x0000000000_00000000000000000028_00000_0000000003_00015? size 8295638
2025-10-13T18:35:32.942138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-13T18:35:32.942162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00000_0000000003_00015? new key d0000000000_00000000000000000028_00000_0000000003_00015? size 8295638 WTime 1760380532940
2025-10-13T18:35:32.942337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 1 NewHead: Offset 31 PartNo 3 PackedSize 717145 count 1 nextOffset 32 batches 2
2025-10-13T18:35:32.942360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-13T18:35:32.942368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-13T18:35:32.942378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-13T18:35:32.942382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-13T18:35:32.942389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-13T18:35:32.943174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 31 PartNo 3 PackedSize 2970343 count 2 nextOffset 33 batches 6
2025-10-13T18:35:32.943197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-13T18:35:32.943204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-13T18:35:32.943209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-13T18:35:32.943215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-13T18:35:32.943220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-13T18:35:32.945416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.945451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.947580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 63 queued_in_partition_duration_ms: 12 }
2025-10-13T18:35:32.947593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 28
2025-10-13T18:35:32.947599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:32.948087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 38 to 38
2025-10-13T18:35:32.948452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.948465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-13T18:35:32.950114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:32.950593Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (11-11)
2025-10-13T18:35:32.950611Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-10-13T18:35:32.546000Z WriteTime: 2025-10-13T18:35:32.627000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "logtype": "unknown", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.952015Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (12-12)
2025-10-13T18:35:32.952028Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:32.944209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 31 PartNo 3 PackedSize 5223541 count 3 nextOffset 34 batches 10
2025-10-13T18:35:32.944240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.944356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 31,3 HeadOffset 28 endOffset 28 curOffset 34 d0000000000_00000000000000000031_00003_0000000003_00009? size 5223531 WTime 1760380532944
2025-10-13T18:35:32.945116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:32.945164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-13T18:35:32.945218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-13T18:35:32.945238Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.945250Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 0 count 3 size 8295638
2025-10-13T18:35:32.945262Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 31 partNo 3 count 3 size 5223531
2025-10-13T18:35:32.945267Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000002_00008?(+) to d0000000000_00000000000000000017_00000_0000000002_00008?(+)
2025-10-13T18:35:32.945270Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000019_00000_0000000003_00012?(+) to d0000000000_00000000000000000019_00000_0000000003_00012?(+)
2025-10-13T18:35:32.945272Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000003_00010|(+) to d0000000000_00000000000000000014_00002_0000000003_00010|(+)
2025-10-13T18:35:32.952922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.953305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.955028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.955049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.955137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-13T18:35:32.955207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-13T18:35:32.955278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-13T18:35:32.955349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-13T18:35:32.955404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-13T18:35:32.955412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-13T18:35:32.955436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.955443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.955508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.955536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.955553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988782 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.955558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 3994387 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.955575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-13T18:35:32.955586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.956041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:32.956047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-13T18:35:32.956054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-13T18:35:32.956057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-13T18:35:32.956289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.956295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-13T18:35:32.956307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:32.956309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.956313Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.956208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.958438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.958754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.959726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.959744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.959815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-13T18:35:32.959867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-13T18:35:32.959948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-13T18:35:32.960007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-13T18:35:32.960048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-13T18:35:32.960052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-13T18:35:32.960078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.960083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.960092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.960113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.960126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-13T18:35:32.960364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.962238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.962607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.962954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.962968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.963040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-13T18:35:32.963092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-13T18:35:32.963143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-13T18:35:32.963200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-13T18:35:32.963257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-13T18:35:32.963261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-13T18:35:32.963278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.963295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.963679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.963686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.963712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-13T18:35:32.963843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.966397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:32.966412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:32.966485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-13T18:35:32.966549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-13T18:35:32.966646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-13T18:35:32.966712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-13T18:35:32.966773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-13T18:35:32.966777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-13T18:35:32.966794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:32.966814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:32.971336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.971351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 31 count 3 size 5223531 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:32.971376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:32.971392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 13517466 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:32.971398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-13T18:35:32.971413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-13T18:35:32.971420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-13T18:35:32.971427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-13T18:35:32.971436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-13T18:35:32.971443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-13T18:35:32.971449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 1 parts 1 suffix '124' size 717135
2025-10-13T18:35:32.971454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-13T18:35:32.971455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:32.971471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:32.971476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 31 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-13T18:35:32.971476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-13T18:35:32.971478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-13T18:35:32.971485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-13T18:35:32.971492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-13T18:35:32.971499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-13T18:35:32.971505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-13T18:35:32.971510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-13T18:35:32.971518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-13T18:35:32.971522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-13T18:35:32.971526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-13T18:35:32.971532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-13T18:35:32.971538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-13T18:35:32.971545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-13T18:35:32.971551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-13T18:35:32.971566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-13T18:35:32.971571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-13T18:35:32.971578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-13T18:35:32.971585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-13T18:35:32.971590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-13T18:35:32.971595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-13T18:35:32.971602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-13T18:35:32.971607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-13T18:35:32.971613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:32.971616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-13T18:35:32.971663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:32.971679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:32.971681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-13T18:35:32.971702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-13T18:35:32.971712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-13T18:35:32.971715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-13T18:35:32.971719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-13T18:35:32.971722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-13T18:35:32.972253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 2253230 count 1 nextOffset 35 batches 5
2025-10-13T18:35:32.972272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-13T18:35:32.972278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-13T18:35:32.972282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-13T18:35:32.972285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-13T18:35:32.972299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-13T18:35:32.972876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 4506428 count 2 nextOffset 36 batches 9
2025-10-13T18:35:32.972894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-13T18:35:32.972900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-13T18:35:32.972905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-13T18:35:32.972908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-13T18:35:32.972912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-13T18:35:32.973499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 6759626 count 3 nextOffset 37 batches 13
2025-10-13T18:35:32.973514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-13T18:35:32.973521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-13T18:35:32.973523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-13T18:35:32.973527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-13T18:35:32.975149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 38 partNo 3 result is x0000000000_00000000000000000034_00000_0000000003_00015? size 8295638
2025-10-13T18:35:32.975159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-13T18:35:32.975170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000034_00000_0000000003_00015? new key d0000000000_00000000000000000034_00000_0000000003_00015? size 8295638 WTime 1760380532974
2025-10-13T18:35:32.975303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 1 NewHead: Offset 37 PartNo 3 PackedSize 717145 count 1 nextOffset 38 batches 2
2025-10-13T18:35:32.975312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:32.975432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 37,1 HeadOffset 34 endOffset 34 curOffset 38 d0000000000_00000000000000000037_00003_0000000001_00001? size 717135 WTime 1760380532974
2025-10-13T18:35:32.976026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.976062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.976068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.976073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.976078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.976083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:32.976863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 41 queued_in_partition_duration_ms: 41 }
2025-10-13T18:35:32.976879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 29
2025-10-13T18:35:32.976886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:32.976990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 41 queued_in_partition_duration_ms: 35 }
2025-10-13T18:35:32.976996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 30
2025-10-13T18:35:32.977037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 31 }
2025-10-13T18:35:32.977041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 31
2025-10-13T18:35:32.977066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 40 queued_in_partition_duration_ms: 27 }
2025-10-13T18:35:32.977075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 32
2025-10-13T18:35:32.977097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 19 }
2025-10-13T18:35:32.977099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 33
2025-10-13T18:35:32.977129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 12 }
2025-10-13T18:35:32.977133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 34
2025-10-13T18:35:32.977637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 39 to 39
2025-10-13T18:35:32.978116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.978131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-13T18:35:32.980053Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:32.983777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 40 to 40
2025-10-13T18:35:32.975556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000001_00004?
2025-10-13T18:35:32.975558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000028_00000_0000000003_00015?
2025-10-13T18:35:32.975560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000031_00003_0000000003_00009?
2025-10-13T18:35:32.975564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 15772389 bytes
2025-10-13T18:35:32.975604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-13T18:35:32.975641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:32.975644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 717135 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:32.975647Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:32.975659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-13T18:35:32.975676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-13T18:35:32.975690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-13T18:35:32.975703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-13T18:35:32.975716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-13T18:35:32.976272Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:32.976285Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 34 partNo 0 count 3 size 8295638
2025-10-13T18:35:32.976292Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 37 partNo 3 count 1 size 717135
2025-10-13T18:35:32.976298Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000003_00015?(+) to d0000000000_00000000000000000022_00000_0000000003_00015?(+)
2025-10-13T18:35:32.976300Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00003_0000000002_00005?(+) to d0000000000_00000000000000000025_00003_0000000002_00005?(+)
2025-10-13T18:35:32.976302Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000001_00001|(+) to d0000000000_00000000000000000021_00003_0000000001_00001|(+)
2025-10-13T18:35:32.976311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-13T18:35:32.976314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000001_00004?
2025-10-13T18:35:32.976323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000028_00000_0000000003_00015?
2025-10-13T18:35:32.976333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000031_00003_0000000003_00009?
2025-10-13T18:35:32.976346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-13T18:35:32.976400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.976403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 28 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.976406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 31 partno 3 count 3 parts_count 9 source 1 size 5223531 accessed 0 times before, last time 2025-10-13T18:35:32.000000Z
2025-10-13T18:35:32.976416Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-13T18:35:32.976453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:32.976457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.976590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:32.976594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:35:32.976597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 31 partno 3 count 3 parts 9 suffix '63'
2025-10-13T18:35:32.976611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-13T18:35:32.976773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-13T18:35:32.976930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-13T18:35:32.977096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-13T18:35:32.977170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-13T18:35:32.977943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-13T18:35:32.977958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.978172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-13T18:35:32.978405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-13T18:35:32.978653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-13T18:35:32.978849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-13T18:35:32.979142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-13T18:35:32.981330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295604
2025-10-13T18:35:32.981339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295604 WTime 1760380532978
2025-10-13T18:35:32.981356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-13T18:35:32.981361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-13T18:35:32.981503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-13T18:35:32.981659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-13T18:35:32.981820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-13T18:35:32.982043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-13T18:35:32.982577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-13T18:35:32.982585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-13T18:35:32.982727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-13T18:35:32.982863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-13T18:35:32.983008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-13T18:35:32.983066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-13T18:35:32.983723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-10-13T18:35:32.985262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-13T18:35:32.985267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-13T18:35:32.985269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-13T18:35:32.985280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:32.985552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-13T18:35:32.986037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-13T18:35:32.986661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
2025-10-13T18:35:32.986683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-13T18:35:32.986655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:32.987198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:32.986875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-13T18:35:32.987089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-13T18:35:32.992608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:32.992627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-13T18:35:32.994325Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (12-12)
2025-10-13T18:35:32.994353Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-10-13T18:35:32.576000Z WriteTime: 2025-10-13T18:35:32.644000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:49910", "_ip": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:32.996163Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (13-13)
2025-10-13T18:35:32.996189Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:33.001341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988738
2025-10-13T18:35:33.001766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-13T18:35:33.001987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-13T18:35:33.002002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988738 WTime 1760380533000
2025-10-13T18:35:33.002251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-10-13T18:35:33.002259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-13T18:35:33.002405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-13T18:35:33.002547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-13T18:35:33.002702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-13T18:35:33.002785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-13T18:35:33.003292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 3482370 count 2 nextOffset 34 batches 7
2025-10-13T18:35:33.003393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,2 HeadOffset 25 endOffset 27 curOffset 34 d0000000000_00000000000000000032_00002_0000000002_00006| size 3482360 WTime 1760380533000
2025-10-13T18:35:33.004144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.004152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.004174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.004179Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.004192Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295604
2025-10-13T18:35:33.004200Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988738
2025-10-13T18:35:33.004207Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 2 size 3482360
2025-10-13T18:35:33.004266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-13T18:35:33.005021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 41 to 41
2025-10-13T18:35:33.005402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.005418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-13T18:35:33.007562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.010417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.011071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.013609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.013635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.013727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-13T18:35:33.013801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-13T18:35:33.013869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-13T18:35:33.013925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-13T18:35:33.013974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-13T18:35:33.013978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-13T18:35:33.014006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.014010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.014222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.014243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.014257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-13T18:35:33.014654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.017020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.017485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.017658Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.019635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.019653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.019739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-13T18:35:33.019802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-13T18:35:33.019869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-13T18:35:33.019950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-13T18:35:33.019987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-13T18:35:33.019994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-13T18:35:33.020097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.020099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.020111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.020134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.020164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 25 count 2 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.020172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 34 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.020175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 37 count 1 size 717135 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.020195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-13T18:35:33.020198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.020214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.020220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-13T18:35:33.020231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-13T18:35:33.020236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-13T18:35:33.020241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-13T18:35:33.020255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-13T18:35:33.020261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-13T18:35:33.020266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-13T18:35:33.020272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-13T18:35:33.020277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-13T18:35:33.020282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-13T18:35:33.020287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-13T18:35:33.020292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-13T18:35:33.020307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-13T18:35:33.020313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-13T18:35:33.020318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-13T18:35:33.020326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-13T18:35:33.020332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-13T18:35:33.020336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-13T18:35:33.020341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-13T18:35:33.020347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.020350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-13T18:35:33.020381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.020396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.020398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:35:33.020419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-13T18:35:33.020429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-13T18:35:33.020432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-13T18:35:33.020435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-13T18:35:33.020438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-13T18:35:33.021032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 2253230 count 1 nextOffset 39 batches 5
2025-10-13T18:35:33.021051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-13T18:35:33.021059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-13T18:35:33.021064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-13T18:35:33.021068Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-13T18:35:33.021073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-13T18:35:33.021769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 4506428 count 2 nextOffset 40 batches 9
2025-10-13T18:35:33.021780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.021885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 38,2 HeadOffset 38 endOffset 38 curOffset 40 d0000000000_00000000000000000038_00000_0000000002_00008? size 4506418 WTime 1760380533020
2025-10-13T18:35:33.022635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.022668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-13T18:35:33.022707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 25 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-13T18:35:33.022723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988782
2025-10-13T18:35:33.022728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.022732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 37 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:33.027006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.028499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 42 to 42
2025-10-13T18:35:33.028847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.028857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-13T18:35:33.030507Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (13-13)
2025-10-13T18:35:33.030524Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:33.030534Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 9011748, ReadSizeServerDelta = -8487460
2025-10-13T18:35:33.030612Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:33.030622Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-10-13T18:35:32.582000Z WriteTime: 2025-10-13T18:35:32.690000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "logtype": "unknown", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.031344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-13T18:35:33.031374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-13T18:35:33.031391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-13T18:35:33.031401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-13T18:35:33.031410Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.031430Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 0 count 2 size 4506418
2025-10-13T18:35:33.031443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988782 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.031447Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.033827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 49 queued_in_partition_duration_ms: 19 }
2025-10-13T18:35:33.033841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 35
2025-10-13T18:35:33.031895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.031940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.031946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.031954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.035187Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 9011748 } }
2025-10-13T18:35:33.035221Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# c8f7446b-8625b7b5-d7fcc93-60ac700a
2025-10-13T18:35:33.035238Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 4b4036a-b90ab5a8-16bd0687-c38edf3c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:33.035250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.035645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.035697Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 14 EndOffset 22 ClientCommitOffset 0 committedOffset 0 Guid 4b4036a-b90ab5a8-16bd0687-c38edf3c
2025-10-13T18:35:33.035410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.035431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.035542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-13T18:35:33.035621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-13T18:35:33.035677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-13T18:35:33.035734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-13T18:35:33.035781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-13T18:35:33.035785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-13T18:35:33.035807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.035831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.036343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 43 to 43
2025-10-13T18:35:33.036601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.036611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-13T18:35:33.038041Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.039609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.039623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.039659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.039661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.039731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-13T18:35:33.039759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 14 count 9 size 524288 endOffset 38 max time lag 0ms effective offset 14
2025-10-13T18:35:33.039793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 2 blobs, size 7988778 count 4 last offset 14, current partition end offset: 38
2025-10-13T18:35:33.039798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-10-13T18:35:33.039807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.039809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 14 partno 2 count 4 parts_count 14 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.039819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 13. Have to read 2 of 2 from KV
2025-10-13T18:35:33.040112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 49 queued_in_partition_duration_ms: 19 }
2025-10-13T18:35:33.040122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 36
2025-10-13T18:35:33.040182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 49 queued_in_partition_duration_ms: 19 }
2025-10-13T18:35:33.040186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 37
2025-10-13T18:35:33.040205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 49 queued_in_partition_duration_ms: 4 }
2025-10-13T18:35:33.040208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 38
2025-10-13T18:35:33.040025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-13T18:35:33.040030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 14 partno 2 count 4 parts_count 14
2025-10-13T18:35:33.042127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 44 to 44
2025-10-13T18:35:33.042437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.042447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-13T18:35:33.043741Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.040384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.044676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.045260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.046620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.046638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.047505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 45 to 45
2025-10-13T18:35:33.047766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.047776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-13T18:35:33.046723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-13T18:35:33.046792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-13T18:35:33.046858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-13T18:35:33.046919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-13T18:35:33.047103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-13T18:35:33.047108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-13T18:35:33.049484Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.049730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.052201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.052547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.053369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 46 to 46
2025-10-13T18:35:33.053741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.053751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-13T18:35:33.047135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.047139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.047150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.047172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.047187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-13T18:35:33.053759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.053771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.053847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-13T18:35:33.053903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-13T18:35:33.053985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-13T18:35:33.054192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-13T18:35:33.054271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-13T18:35:33.054277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-13T18:35:33.054306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.054314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.054326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.054349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.054363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-13T18:35:33.055784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.057572Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.059397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.059708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.061950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 47 to 47
2025-10-13T18:35:33.062291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.062302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-13T18:35:33.060928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.060949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.061179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-13T18:35:33.061258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-13T18:35:33.061319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-13T18:35:33.061382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-13T18:35:33.061433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-13T18:35:33.061439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-13T18:35:33.061467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.061470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.061482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.061504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.061517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-10-13T18:35:33.063503Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.062473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.066950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 48 to 48
2025-10-13T18:35:33.067337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.067348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-13T18:35:33.067449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.067802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.068807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.068826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.069504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-13T18:35:33.069565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-13T18:35:33.069624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-13T18:35:33.069682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-13T18:35:33.070296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-13T18:35:33.070301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-13T18:35:33.070328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.070332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.070343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.070364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.070385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-13T18:35:33.070537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:33.070580Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.071197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.073280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.073741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.074026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.074047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.074122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-13T18:35:33.074179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-13T18:35:33.074235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-13T18:35:33.074297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-13T18:35:33.074358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-13T18:35:33.074363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-13T18:35:33.074389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.074393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.074419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.074437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.074579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-13T18:35:33.075591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.078215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.078233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.078305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-13T18:35:33.078366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-13T18:35:33.078428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-13T18:35:33.077797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.078084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.078487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-13T18:35:33.078562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-13T18:35:33.078574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-13T18:35:33.078620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.078631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.078641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.078664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.081678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-13T18:35:33.081694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:35:33.081696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-13T18:35:33.081704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.081707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.081754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-13T18:35:33.081774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295604 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.081783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988738 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.081786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 2 size 3482360 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.081806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-13T18:35:33.084296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-13T18:35:33.084494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.084650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.084866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:35:33.085176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-13T18:35:33.085186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-13T18:35:33.085193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:33.085205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.085209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:33.085223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 31 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-13T18:35:33.085225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-13T18:35:33.085230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.085232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:35:33.085237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 37 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:33.085245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-13T18:35:33.085248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-10-13T18:35:33.093342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.092433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.092610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.092762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.092981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 15 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:35:33.093149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.093349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.093526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.093638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 16 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:35:33.093804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:33.093990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.094169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.094341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.094492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 17 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:35:33.094558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.095176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.095192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000003_00015?
2025-10-13T18:35:33.095194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000037_00003_0000000001_00001?
2025-10-13T18:35:33.095197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes
2025-10-13T18:35:33.095222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 8295638 cause it's been evicted from L2. Actual L1 size: 10
2025-10-13T18:35:33.095226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 3994387 cause it's been evicted from L2. Actual L1 size: 9
2025-10-13T18:35:33.095229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 2253220 cause it's been evicted from L2. Actual L1 size: 8
2025-10-13T18:35:33.095234Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.095252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 34 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.095254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.095256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 37 size 717135 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:33.095259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 31 size 5223531 cause it's been evicted from L2. Actual L1 size: 4
2025-10-13T18:35:33.095261Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.095299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 14
2025-10-13T18:35:33.095323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:33.095326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00000_0000000003_00015?
2025-10-13T18:35:33.095337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000037_00003_0000000001_00001?
2025-10-13T18:35:33.095348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:33.100399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.100417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.100498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-13T18:35:33.100551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-13T18:35:33.100616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-13T18:35:33.100677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-13T18:35:33.100725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-13T18:35:33.100729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-13T18:35:33.100754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 0 count 3 parts_count 15 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.100756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 37 partno 3 count 1 parts_count 1 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.100775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 2 from KV
2025-10-13T18:35:33.100787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.100809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.100978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 0 count 3 parts_count 15
2025-10-13T18:35:33.100982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 37 partno 3 count 1 parts_count 1
2025-10-13T18:35:33.104120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.111181Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 38 Result { Offset: 14 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 15 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532691 CreateTimestampMS: 1760380532590 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 16 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532691 CreateTimestampMS: 1760380532600 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 17 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532692 CreateTimestampMS: 1760380532659 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 18 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532741 CreateTimestampMS: 1760380532671 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 17308807 RealReadOffset: 17 WaitQuotaTimeMs: 0 EndOffset: 38 StartOffset: 0 } Cookie: 14 }
2025-10-13T18:35:33.112590Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 18 endOffset 38
2025-10-13T18:35:33.112619Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 38 ReadOffset 18 ReadGuid 4b4036a-b90ab5a8-16bd0687-c38edf3c has messages 1
2025-10-13T18:35:33.112662Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 18, endOffset# 38, WTime# 1760380532741, sizeLag# 17308807
2025-10-13T18:35:33.112666Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:33.112679Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 4b4036a-b90ab5a8-16bd0687-c38edf3c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011748
2025-10-13T18:35:33.112689Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 4b4036a-b90ab5a8-16bd0687-c38edf3c
2025-10-13T18:35:33.116016Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:33.125641Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 9011748, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487460
2025-10-13T18:35:33.125778Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (14-14)
2025-10-13T18:35:33.125797Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 9011748 to budget
2025-10-13T18:35:33.142531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 2 size 4506418 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.142564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.142590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.142599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-13T18:35:33.142617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-10-13T18:35:33.142625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-10-13T18:35:33.142636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-10-13T18:35:33.142649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-10-13T18:35:33.142656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-13T18:35:33.142663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-10-13T18:35:33.142669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-10-13T18:35:33.142683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-10-13T18:35:33.142691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.142695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-10-13T18:35:33.142748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.142780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.142784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (40)
2025-10-13T18:35:33.142809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-13T18:35:33.142821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-13T18:35:33.142825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-13T18:35:33.142828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-13T18:35:33.142832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-13T18:35:33.143367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-13T18:35:33.143391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-13T18:35:33.143397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-13T18:35:33.143401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-13T18:35:33.143404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-13T18:35:33.143407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-13T18:35:33.144062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 4506428 count 2 nextOffset 42 batches 9
2025-10-13T18:35:33.144080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-13T18:35:33.144087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-13T18:35:33.144090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-13T18:35:33.144093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-13T18:35:33.144097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-13T18:35:33.144664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 6759626 count 3 nextOffset 43 batches 13
2025-10-13T18:35:33.144681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-13T18:35:33.144687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-13T18:35:33.144692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-13T18:35:33.144695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-13T18:35:33.146241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 44 partNo 3 result is x0000000000_00000000000000000040_00000_0000000003_00015? size 8295638
2025-10-13T18:35:33.146250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-13T18:35:33.146263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000040_00000_0000000003_00015? new key d0000000000_00000000000000000040_00000_0000000003_00015? size 8295638 WTime 1760380533141
2025-10-13T18:35:33.146407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 3 PackedSize 717145 count 1 nextOffset 44 batches 2
2025-10-13T18:35:33.146429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-13T18:35:33.146438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-13T18:35:33.146442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-13T18:35:33.146447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-13T18:35:33.146451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-13T18:35:33.147144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 2970343 count 2 nextOffset 45 batches 6
2025-10-13T18:35:33.147163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-13T18:35:33.147172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-13T18:35:33.147176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-13T18:35:33.147180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-13T18:35:33.147183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-13T18:35:33.147482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:33.148988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 5223541 count 3 nextOffset 46 batches 10
2025-10-13T18:35:33.149020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-13T18:35:33.149027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-13T18:35:33.149032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-13T18:35:33.149035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-13T18:35:33.149039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-13T18:35:33.149695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 3 PackedSize 7476739 count 4 nextOffset 47 batches 14
2025-10-13T18:35:33.149713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-13T18:35:33.149719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-13T18:35:33.151883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 48 partNo 1 result is x0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
2025-10-13T18:35:33.151900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-13T18:35:33.151907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-13T18:35:33.151913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-13T18:35:33.151940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00003_0000000004_00014? new key d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760 WTime 1760380533151
2025-10-13T18:35:33.152387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 1 NewHead: Offset 47 PartNo 1 PackedSize 1741199 count 1 nextOffset 48 batches 4
2025-10-13T18:35:33.152405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.152522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 47,1 HeadOffset 40 endOffset 40 curOffset 48 d0000000000_00000000000000000047_00001_0000000001_00003? size 1741189 WTime 1760380533152
2025-10-13T18:35:33.152808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.152867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-13T18:35:33.152898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-13T18:35:33.152930Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.152942Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 3 size 8295638
2025-10-13T18:35:33.152950Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 3 count 4 size 7988760
2025-10-13T18:35:33.152958Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 47 partNo 1 count 1 size 1741189
2025-10-13T18:35:33.152963Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000001_00004?(+) to d0000000000_00000000000000000027_00000_0000000001_00004?(+)
2025-10-13T18:35:33.152966Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00000_0000000003_00015?(+) to d0000000000_00000000000000000028_00000_0000000003_00015?(+)
2025-10-13T18:35:33.152968Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000031_00003_0000000003_00009?(+) to d0000000000_00000000000000000031_00003_0000000003_00009?(+)
2025-10-13T18:35:33.152970Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-10-13T18:35:33.156442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.156499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.157102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 121 queued_in_partition_duration_ms: 5 }
2025-10-13T18:35:33.157120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 39
2025-10-13T18:35:33.157127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:33.157669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 121 }
2025-10-13T18:35:33.157677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 40
2025-10-13T18:35:33.160176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 49 to 49
2025-10-13T18:35:33.160490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.160505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-13T18:35:33.162298Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (14-14)
2025-10-13T18:35:33.162320Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-10-13T18:35:32.590000Z WriteTime: 2025-10-13T18:35:32.691000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.162563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-13T18:35:33.162578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:35:33.162580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-13T18:35:33.162589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.162593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 37 count 1 size 717135 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.163970Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (15-15)
2025-10-13T18:35:33.163999Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:33.162651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:33.162658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.162797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-13T18:35:33.162931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-13T18:35:33.163070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-13T18:35:33.163209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-13T18:35:33.163432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-13T18:35:33.163892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 2253230 count 1 nextOffset 35 batches 5
2025-10-13T18:35:33.163903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-13T18:35:33.164019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:33.164025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.164037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 37 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:33.164464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-13T18:35:33.164619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-13T18:35:33.164841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-13T18:35:33.165158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-13T18:35:33.165787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 4506428 count 2 nextOffset 36 batches 9
2025-10-13T18:35:33.165797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-13T18:35:33.167272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 37 partNo 0 result is x0000000000_00000000000000000032_00002_0000000004_00014 size 7988778
2025-10-13T18:35:33.167317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 50 to 50
2025-10-13T18:35:33.167669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.167680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-13T18:35:33.167438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-13T18:35:33.167666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-13T18:35:33.168048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.168019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-13T18:35:33.168110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-13T18:35:33.168125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00002_0000000004_00014 new key d0000000000_00000000000000000032_00002_0000000004_00014 size 7988778 WTime 1760380533168
2025-10-13T18:35:33.168617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 37 partNo 4 FormedBlobsCount 1 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-13T18:35:33.169128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:33.169173Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.168431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.169082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-13T18:35:33.169093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-13T18:35:33.169096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-13T18:35:33.169105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.169288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-13T18:35:33.169364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-13T18:35:33.170047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-13T18:35:33.170140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,2 HeadOffset 32 endOffset 34 curOffset 38 d0000000000_00000000000000000036_00000_0000000002_00008| size 4506418 WTime 1760380533168
2025-10-13T18:35:33.171245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.171253Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.171279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.171288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.171299Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.171310Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 4 size 7988778
2025-10-13T18:35:33.171317Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 2 size 4506418
2025-10-13T18:35:33.171370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-10-13T18:35:33.172013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.174207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.174523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.176356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.176372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.176445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-10-13T18:35:33.176496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-10-13T18:35:33.176561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-10-13T18:35:33.176613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-10-13T18:35:33.176660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-10-13T18:35:33.176664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-10-13T18:35:33.176688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.176691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.176700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.176723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.176728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-13T18:35:33.196336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 40 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.196359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 43 count 4 size 7988760 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.196364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 47 count 1 size 1741189 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.196387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.196410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18023288 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.196432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-13T18:35:33.196451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 1, Offset: 40 is stored on disk
2025-10-13T18:35:33.196460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 2, Offset: 40 is stored on disk
2025-10-13T18:35:33.196470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 3, Offset: 40 is stored on disk
2025-10-13T18:35:33.196487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 4, Offset: 40 is stored on disk
2025-10-13T18:35:33.196493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-13T18:35:33.196501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 1, Offset: 41 is stored on disk
2025-10-13T18:35:33.196509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 2, Offset: 41 is stored on disk
2025-10-13T18:35:33.196517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 3, Offset: 41 is stored on disk
2025-10-13T18:35:33.196527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 4, Offset: 41 is stored on disk
2025-10-13T18:35:33.196536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-13T18:35:33.196543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 1, Offset: 42 is stored on disk
2025-10-13T18:35:33.196551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 2, Offset: 42 is stored on disk
2025-10-13T18:35:33.196560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 3, Offset: 42 is stored on disk
2025-10-13T18:35:33.196570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 4, Offset: 42 is stored on disk
2025-10-13T18:35:33.196579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-13T18:35:33.196588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 1, Offset: 43 is stored on disk
2025-10-13T18:35:33.196595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 2, Offset: 43 is stored on disk
2025-10-13T18:35:33.196603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 3, Offset: 43 is stored on disk
2025-10-13T18:35:33.196612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 4, Offset: 43 is stored on disk
2025-10-13T18:35:33.196623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-13T18:35:33.196632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 1, Offset: 44 is stored on disk
2025-10-13T18:35:33.196639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 2, Offset: 44 is stored on disk
2025-10-13T18:35:33.196647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 3, Offset: 44 is stored on disk
2025-10-13T18:35:33.196656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 4, Offset: 44 is stored on disk
2025-10-13T18:35:33.196669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-13T18:35:33.196678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 1, Offset: 45 is stored on disk
2025-10-13T18:35:33.196685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 2, Offset: 45 is stored on disk
2025-10-13T18:35:33.196694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 3, Offset: 45 is stored on disk
2025-10-13T18:35:33.196701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 4, Offset: 45 is stored on disk
2025-10-13T18:35:33.196708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-13T18:35:33.196714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 1, Offset: 46 is stored on disk
2025-10-13T18:35:33.196720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 2, Offset: 46 is stored on disk
2025-10-13T18:35:33.196726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 3, Offset: 46 is stored on disk
2025-10-13T18:35:33.196732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 4, Offset: 46 is stored on disk
2025-10-13T18:35:33.196738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-13T18:35:33.196745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 1, Offset: 47 is stored on disk
2025-10-13T18:35:33.196751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 2, Offset: 47 is stored on disk
2025-10-13T18:35:33.196758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 3, Offset: 47 is stored on disk
2025-10-13T18:35:33.196764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.196768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 4, Offset: 47 is stored on disk
2025-10-13T18:35:33.197172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.197183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.197186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:33.197217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-13T18:35:33.197227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-13T18:35:33.197231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-13T18:35:33.197234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-13T18:35:33.197237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-13T18:35:33.197661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 48 PartNo 0 PackedSize 2253230 count 1 nextOffset 49 batches 5
2025-10-13T18:35:33.197670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.197777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 48,1 HeadOffset 48 endOffset 48 curOffset 49 d0000000000_00000000000000000048_00000_0000000001_00004? size 2253220 WTime 1760380533197
2025-10-13T18:35:33.198077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.198105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-13T18:35:33.198130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-10-13T18:35:33.198143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
2025-10-13T18:35:33.198155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 44
2025-10-13T18:35:33.198169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 45
2025-10-13T18:35:33.198179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-13T18:35:33.198188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 47
2025-10-13T18:35:33.198195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 48
2025-10-13T18:35:33.198201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-10-13T18:35:33.198205Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.198213Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 48 partNo 0 count 1 size 2253220
2025-10-13T18:35:33.198625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-13T18:35:33.198632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.198637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-13T18:35:33.198641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 43 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-13T18:35:33.198647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 2 parts 6 suffix '124' size 3482360
2025-10-13T18:35:33.198651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 47 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-13T18:35:33.199067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.199171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.200941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 107 }
2025-10-13T18:35:33.200953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 41
2025-10-13T18:35:33.200959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:33.201572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 51 to 51
2025-10-13T18:35:33.201927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.201939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-13T18:35:33.203165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:33.203512Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (15-15)
2025-10-13T18:35:33.203530Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:33.202564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 3482360 cause it's been evicted from L2. Actual L1 size: 8
2025-10-13T18:35:33.202577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 7988738 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.202580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295604 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.202584Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.203766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.203775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.203863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 99 size: 511959
2025-10-13T18:35:33.203954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 99 size: 511959
2025-10-13T18:35:33.204050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 99 size: 511959
2025-10-13T18:35:33.204139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 99 size: 511959
2025-10-13T18:35:33.204202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size: 205040
2025-10-13T18:35:33.204208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 99 size 205040 offset: -1
2025-10-13T18:35:33.204236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.204262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-10-13T18:35:32.600000Z WriteTime: 2025-10-13T18:35:32.691000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.207135Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (16-16)
2025-10-13T18:35:33.207149Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:33.207509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 97 }
2025-10-13T18:35:33.207518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 42
2025-10-13T18:35:33.207524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:33.207570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 91 }
2025-10-13T18:35:33.207573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 43
2025-10-13T18:35:33.207590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 80 }
2025-10-13T18:35:33.207593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 44
2025-10-13T18:35:33.207610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 76 }
2025-10-13T18:35:33.207612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 45
2025-10-13T18:35:33.207628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 71 }
2025-10-13T18:35:33.207633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 46
2025-10-13T18:35:33.207651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 47 queued_in_partition_duration_ms: 73 }
2025-10-13T18:35:33.207653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 47
2025-10-13T18:35:33.207669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 47 queued_in_partition_duration_ms: 48 }
2025-10-13T18:35:33.207671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 48
2025-10-13T18:35:33.208244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.209153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.209484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.209803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.209815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.209836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 51
2025-10-13T18:35:33.212143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 4 size 7988778 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.212153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.212164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.212711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:33.212719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.212723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:33.212727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-13T18:35:33.213439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 52 to 52
2025-10-13T18:35:33.213256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.213266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000038_00000_0000000002_00008?
2025-10-13T18:35:33.213270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000003_00015?
2025-10-13T18:35:33.213272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 12802056 bytes
2025-10-13T18:35:33.213283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 34 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.213285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.213288Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.213315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-13T18:35:33.213317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000038_00000_0000000002_00008?
2025-10-13T18:35:33.213324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000003_00015?
2025-10-13T18:35:33.213333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-13T18:35:33.213418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 38 partno 0 count 2 parts_count 8 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.213422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 40 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-13T18:35:33.000000Z
2025-10-13T18:35:33.213429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-13T18:35:33.212152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.213579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 3 parts 15 suffix '63'
2025-10-13T18:35:33.213585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 38 partno 0 count 2 parts_count 8
2025-10-13T18:35:33.214852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.214865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-13T18:35:33.216077Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.215903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.215929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.215998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 101 size: 511959
2025-10-13T18:35:33.216049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 101 size: 511959
2025-10-13T18:35:33.216111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 101 size: 511959
2025-10-13T18:35:33.216170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 101 size: 511959
2025-10-13T18:35:33.216217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 101 size: 205040
2025-10-13T18:35:33.216222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 101 size 205040 offset: -1
2025-10-13T18:35:33.216281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.216300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.216308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 48 count 1 size 2253220 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.216326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.216343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.216349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.216357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-13T18:35:33.216360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.216364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 1, Offset: 48 is stored on disk
2025-10-13T18:35:33.216366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.216370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 2, Offset: 48 is stored on disk
2025-10-13T18:35:33.216373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.216379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 3, Offset: 48 is stored on disk
2025-10-13T18:35:33.216384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.216388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 4, Offset: 48 is stored on disk
2025-10-13T18:35:33.216416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.216427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.216429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-13T18:35:33.216445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-13T18:35:33.216455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-13T18:35:33.216459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-13T18:35:33.216463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-13T18:35:33.216466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-13T18:35:33.216967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 0 PackedSize 2253230 count 1 nextOffset 50 batches 5
2025-10-13T18:35:33.216983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-13T18:35:33.216987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 1
2025-10-13T18:35:33.216992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 2
2025-10-13T18:35:33.216995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 3
2025-10-13T18:35:33.216998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 4
2025-10-13T18:35:33.217661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 0 PackedSize 4506428 count 2 nextOffset 51 batches 9
2025-10-13T18:35:33.217672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.217775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 49,2 HeadOffset 49 endOffset 49 curOffset 51 d0000000000_00000000000000000049_00000_0000000002_00008? size 4506418 WTime 1760380533217
2025-10-13T18:35:33.218440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.218469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 49
2025-10-13T18:35:33.218500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 48 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:33.219135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 53 to 53
2025-10-13T18:35:33.219409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.219423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-13T18:35:33.219767Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (16-16)
2025-10-13T18:35:33.219784Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:33.220036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.220604Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.220625Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 49 partNo 0 count 2 size 4506418
2025-10-13T18:35:33.220633Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000034_00000_0000000003_00015?(+) to d0000000000_00000000000000000034_00000_0000000003_00015?(+)
2025-10-13T18:35:33.220635Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000037_00003_0000000001_00001?(+) to d0000000000_00000000000000000037_00003_0000000001_00001?(+)
2025-10-13T18:35:33.220638Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00002_0000000002_00006|(+) to d0000000000_00000000000000000032_00002_0000000002_00006|(+)
2025-10-13T18:35:33.222007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 20 }
2025-10-13T18:35:33.222020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 49
2025-10-13T18:35:33.222594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.222894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.223254Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (17-17)
2025-10-13T18:35:33.223275Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:33.223463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-13T18:35:33.223475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:35:33.223482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 38 count 2 size 4506418 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.223519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:33.223524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.223748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-13T18:35:33.223995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-13T18:35:33.224149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-13T18:35:33.224296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-13T18:35:33.224532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-13T18:35:33.224965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 2253230 count 1 nextOffset 39 batches 5
2025-10-13T18:35:33.224975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-13T18:35:33.225124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-13T18:35:33.225285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-13T18:35:33.225478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-13T18:35:33.227221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 40 partNo 3 result is x0000000000_00000000000000000036_00000_0000000003_00015 size 8295660
2025-10-13T18:35:33.227323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-13T18:35:33.227335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000036_00000_0000000003_00015 new key d0000000000_00000000000000000036_00000_0000000003_00015 size 8295660 WTime 1760380533226
2025-10-13T18:35:33.227446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 40 partNo 4 FormedBlobsCount 1 NewHead: Offset 39 PartNo 3 PackedSize 717145 count 1 nextOffset 40 batches 2
2025-10-13T18:35:33.227453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.227597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-13T18:35:33.227744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-13T18:35:33.227888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-13T18:35:33.227900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 37 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:33.227908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 43 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-13T18:35:33.227913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:33.228312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-13T18:35:33.228559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-13T18:35:33.229085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 2970343 count 2 nextOffset 41 batches 6
2025-10-13T18:35:33.229092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-13T18:35:33.229259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-13T18:35:33.229410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-13T18:35:33.229556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-13T18:35:33.229810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-13T18:35:33.230335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 5223541 count 3 nextOffset 42 batches 10
2025-10-13T18:35:33.230340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-13T18:35:33.230519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-13T18:35:33.230674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-13T18:35:33.230864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-13T18:35:33.230942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-13T18:35:33.231434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 39 PartNo 3 PackedSize 7476739 count 4 nextOffset 43 batches 14
2025-10-13T18:35:33.232114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-13T18:35:33.232125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-13T18:35:33.233890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 44 partNo 1 result is x0000000000_00000000000000000039_00003_0000000004_00014 size 7988760
2025-10-13T18:35:33.233902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-13T18:35:33.233995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,4 HeadOffset 36 endOffset 38 curOffset 43 d0000000000_00000000000000000039_00003_0000000004_00013| size 7476729 WTime 1760380533233
2025-10-13T18:35:33.234811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 43 size 7988760 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.234814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 37 size 717135 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.234817Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.234848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.234853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.234877Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.234886Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 8295660
2025-10-13T18:35:33.234891Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 3 count 4 size 7476729
2025-10-13T18:35:33.235097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 52
2025-10-13T18:35:33.235590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-10-13T18:35:32.659000Z WriteTime: 2025-10-13T18:35:32.692000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.239745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 54 to 54
2025-10-13T18:35:33.239608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.239625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.239698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 103 size: 511959
2025-10-13T18:35:33.239748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 103 size: 511959
2025-10-13T18:35:33.239805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 103 size: 511959
2025-10-13T18:35:33.239861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 103 size: 511959
2025-10-13T18:35:33.239915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 103 size: 205040
2025-10-13T18:35:33.239937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 103 size 205040 offset: -1
2025-10-13T18:35:33.240020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.240043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.240068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 49 count 2 size 4506418 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.240085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.240101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.240107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-10-13T18:35:33.240120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 1, Offset: 49 is stored on disk
2025-10-13T18:35:33.240126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 2, Offset: 49 is stored on disk
2025-10-13T18:35:33.240134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 3, Offset: 49 is stored on disk
2025-10-13T18:35:33.240144Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 4, Offset: 49 is stored on disk
2025-10-13T18:35:33.240151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-10-13T18:35:33.240155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 1, Offset: 50 is stored on disk
2025-10-13T18:35:33.240160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 2, Offset: 50 is stored on disk
2025-10-13T18:35:33.240168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 3, Offset: 50 is stored on disk
2025-10-13T18:35:33.240175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.240181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 4, Offset: 50 is stored on disk
2025-10-13T18:35:33.240219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.240231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.240233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-13T18:35:33.240252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-13T18:35:33.240262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 1
2025-10-13T18:35:33.240266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 2
2025-10-13T18:35:33.240269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 3
2025-10-13T18:35:33.240272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 4
2025-10-13T18:35:33.240917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 4 FormedBlobsCount 0 NewHead: Offset 51 PartNo 0 PackedSize 2253230 count 1 nextOffset 52 batches 5
2025-10-13T18:35:33.240932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.241054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 51,1 HeadOffset 51 endOffset 51 curOffset 52 d0000000000_00000000000000000051_00000_0000000001_00004? size 2253220 WTime 1760380533240
2025-10-13T18:35:33.241432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.241459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 50
2025-10-13T18:35:33.241478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 51
2025-10-13T18:35:33.241485Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.241495Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 51 partNo 0 count 1 size 2253220
2025-10-13T18:35:33.241890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 47 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-13T18:35:33.241900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 49 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:33.242124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.242151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.242170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.242888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.243265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 47 size 1741189 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.243272Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.243286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.243290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.243308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 53
2025-10-13T18:35:33.243440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.244206Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:17:0
2025-10-13T18:35:33.244229Z :INFO: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 40550426 MessagesRead: 18 BytesReadCompressed: 40550426 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 0 BytesInflightTotal: 2252802 MessagesInflight: 1 }
2025-10-13T18:35:33.244386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.244404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-13T18:35:33.245705Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.246049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.246060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.246109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 105 size: 511959
2025-10-13T18:35:33.246151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 1 messageNo: 105 size: 511959
2025-10-13T18:35:33.246194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 2 messageNo: 105 size: 511959
2025-10-13T18:35:33.246241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 3 messageNo: 105 size: 511959
2025-10-13T18:35:33.246282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 105 size: 205040
2025-10-13T18:35:33.246285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 105 size 205040 offset: -1
2025-10-13T18:35:33.246310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.246325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.249359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.249624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.249818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.249839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.249860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 54
2025-10-13T18:35:33.250251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.250564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 12 }
2025-10-13T18:35:33.250572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 50
2025-10-13T18:35:33.250654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 23 }
2025-10-13T18:35:33.250656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 51
2025-10-13T18:35:33.251346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 55 to 55
2025-10-13T18:35:33.251607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.251616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-13T18:35:33.253252Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (17-17)
2025-10-13T18:35:33.253271Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:33.253280Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] In ContinueReadingDataImpl, ReadSizeBudget = 9011748, ReadSizeServerDelta = -8487460
2025-10-13T18:35:33.253350Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-13T18:35:33.253358Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
2025-10-13T18:35:33.253079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.253092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.253167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 107 size: 511959
2025-10-13T18:35:33.253239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 1 messageNo: 107 size: 511959
2025-10-13T18:35:33.253331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 2 messageNo: 107 size: 511959
2025-10-13T18:35:33.253420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 3 messageNo: 107 size: 511959
2025-10-13T18:35:33.253479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 107 size: 205040
2025-10-13T18:35:33.253485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 107 size 205040 offset: -1
2025-10-13T18:35:33.253520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.253541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-10-13T18:35:32.671000Z WriteTime: 2025-10-13T18:35:32.741000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.256189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 56 to 56
2025-10-13T18:35:33.256429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.256438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-13T18:35:33.256477Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.258878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 57 to 57
2025-10-13T18:35:33.258762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.258775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.258823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 18 count 24 size 524288 endOffset 51 max time lag 0ms effective offset 18
2025-10-13T18:35:33.258848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 8295638 count 3 last offset 18, current partition end offset: 51
2025-10-13T18:35:33.258852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-10-13T18:35:33.258863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 18 partno 0 count 3 parts_count 15 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.258885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 14. Have to read 1 of 1 from KV
2025-10-13T18:35:33.258366Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 grpc read done: success# 1, data# { read_request { bytes_size: 9011748 } }
2025-10-13T18:35:33.258409Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 got read request: guid# e1a4ef8-2845a1b4-a85a90ff-1ef5d6b3
2025-10-13T18:35:33.258430Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 performing read request: guid# 610fd145-4bc239c5-11ae10ee-6b3d882c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 24, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-13T18:35:33.259129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.258451Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 24 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 18 EndOffset 38 ClientCommitOffset 0 committedOffset 0 Guid 610fd145-4bc239c5-11ae10ee-6b3d882c
2025-10-13T18:35:33.259147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-13T18:35:33.259120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 18 partno 0 count 3 parts_count 15
2025-10-13T18:35:33.258496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.259007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.260361Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.259766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.259774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.259886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 3 size 8295660 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.259890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 39 count 4 size 7476729 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.259929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 55
2025-10-13T18:35:33.259938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.261357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.261364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.261367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.261370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.261373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.261376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489587 bytes
2025-10-13T18:35:33.261388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-13T18:35:33.261391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.261405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.261415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.261427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.261437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-13T18:35:33.261445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 43 partno 3 count 4 parts_count 14 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.261448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 47 partno 1 count 1 parts_count 3 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.261454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 48 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-13T18:35:33.000000Z
2025-10-13T18:35:33.261458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 49 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-13T18:35:33.000000Z
2025-10-13T18:35:33.261471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 4 from KV
2025-10-13T18:35:33.261765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-13T18:35:33.261773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-13T18:35:33.261779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-13T18:35:33.261784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.261787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-13T18:35:33.261802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 48 partno 0 count 1 parts 4 suffix '63'
2025-10-13T18:35:33.261805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 49 partno 0 count 2 parts 8 suffix '63'
2025-10-13T18:35:33.261809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 43 partno 3 count 4 parts_count 14
2025-10-13T18:35:33.261811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 47 partno 1 count 1 parts_count 3
2025-10-13T18:35:33.262228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 40 size 8295638 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.262234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.262237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-10-13T18:35:33.262240Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.263031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 58 to 58
2025-10-13T18:35:33.263327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.263336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-13T18:35:33.263371Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.265680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 59 to 59
2025-10-13T18:35:33.265959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.265964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-13T18:35:33.266807Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.265412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.268364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.268684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.268296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.268313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.268444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 109 size: 511959
2025-10-13T18:35:33.268519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 1 messageNo: 109 size: 511959
2025-10-13T18:35:33.268609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 2 messageNo: 109 size: 511959
2025-10-13T18:35:33.268699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 3 messageNo: 109 size: 511959
2025-10-13T18:35:33.268753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 109 size: 205040
2025-10-13T18:35:33.268757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 109 size 205040 offset: -1
2025-10-13T18:35:33.268778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.268800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.268996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.269002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.269021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 56
2025-10-13T18:35:33.269103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 60 to 60
2025-10-13T18:35:33.269416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.269427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 60
2025-10-13T18:35:33.269470Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.269221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.271660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 61 to 61
2025-10-13T18:35:33.271972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.271981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 61
2025-10-13T18:35:33.271988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:33.272017Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.272822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.273218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.273909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.273925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.274023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 111 size: 511959
2025-10-13T18:35:33.274099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 1 messageNo: 111 size: 511959
2025-10-13T18:35:33.274170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 2 messageNo: 111 size: 511959
2025-10-13T18:35:33.274231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 3 messageNo: 111 size: 511959
2025-10-13T18:35:33.274286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 111 size: 205040
2025-10-13T18:35:33.274290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 111 size 205040 offset: -1
2025-10-13T18:35:33.274330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 51 count 1 size 2253220 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.274354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.274358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.274370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.274400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 51 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:33.274404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.274407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.274426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.274432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.274442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-10-13T18:35:33.274446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.274450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 1, Offset: 51 is stored on disk
2025-10-13T18:35:33.274452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.274456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 2, Offset: 51 is stored on disk
2025-10-13T18:35:33.274457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.274461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 3, Offset: 51 is stored on disk
2025-10-13T18:35:33.274468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.274472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 4, Offset: 51 is stored on disk
2025-10-13T18:35:33.274507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.274522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.274525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-13T18:35:33.274544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-13T18:35:33.274554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 1
2025-10-13T18:35:33.274558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 2
2025-10-13T18:35:33.274564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 3
2025-10-13T18:35:33.274567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 4
2025-10-13T18:35:33.275053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 4 FormedBlobsCount 0 NewHead: Offset 52 PartNo 0 PackedSize 2253230 count 1 nextOffset 53 batches 5
2025-10-13T18:35:33.275072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-13T18:35:33.275077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 1
2025-10-13T18:35:33.275080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 2
2025-10-13T18:35:33.275083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 3
2025-10-13T18:35:33.275087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 4
2025-10-13T18:35:33.275737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 4 FormedBlobsCount 0 NewHead: Offset 52 PartNo 0 PackedSize 4506428 count 2 nextOffset 54 batches 9
2025-10-13T18:35:33.275749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-13T18:35:33.275753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 1
2025-10-13T18:35:33.275759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 2
2025-10-13T18:35:33.275762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 3
2025-10-13T18:35:33.275766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 4
2025-10-13T18:35:33.276331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 4 FormedBlobsCount 0 NewHead: Offset 52 PartNo 0 PackedSize 6759626 count 3 nextOffset 55 batches 13
2025-10-13T18:35:33.276343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-13T18:35:33.276348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 1
2025-10-13T18:35:33.276352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 2
2025-10-13T18:35:33.276355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 3
2025-10-13T18:35:33.278081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 56 partNo 3 result is x0000000000_00000000000000000052_00000_0000000003_00015? size 8295638
2025-10-13T18:35:33.278090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 4
2025-10-13T18:35:33.278102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000052_00000_0000000003_00015? new key d0000000000_00000000000000000052_00000_0000000003_00015? size 8295638 WTime 1760380533277
2025-10-13T18:35:33.278439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 4 FormedBlobsCount 1 NewHead: Offset 55 PartNo 3 PackedSize 717145 count 1 nextOffset 56 batches 2
2025-10-13T18:35:33.278447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.278576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 55,1 HeadOffset 52 endOffset 52 curOffset 56 d0000000000_00000000000000000055_00003_0000000001_00001? size 717135 WTime 1760380533278
2025-10-13T18:35:33.278713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.278761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 52
2025-10-13T18:35:33.278807Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.278818Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 52 partNo 0 count 3 size 8295638
2025-10-13T18:35:33.278826Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 55 partNo 3 count 1 size 717135
2025-10-13T18:35:33.278831Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000038_00000_0000000002_00008?(+) to d0000000000_00000000000000000038_00000_0000000002_00008?(+)
2025-10-13T18:35:33.278833Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000040_00000_0000000003_00015?(+) to d0000000000_00000000000000000040_00000_0000000003_00015?(+)
2025-10-13T18:35:33.278836Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000036_00000_0000000002_00008|(+) to d0000000000_00000000000000000036_00000_0000000002_00008|(+)
2025-10-13T18:35:33.278842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 57
2025-10-13T18:35:33.280654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.280677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.283090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.283496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.284179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 33 }
2025-10-13T18:35:33.284200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 52
2025-10-13T18:35:33.284206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:33.284629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 62 to 62
2025-10-13T18:35:33.284974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.284987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 62
2025-10-13T18:35:33.286451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:33.286507Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.283667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-13T18:35:33.283675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:35:33.283683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.283734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-13T18:35:33.283939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-13T18:35:33.284096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.284294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.284454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.284696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 18 totakecount 3 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:35:33.284840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.284984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.285094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:33.285100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-13T18:35:33.285138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.285409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 19 totakecount 3 count 1 size 717095 from pos 0 cbcount 2
2025-10-13T18:35:33.285583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.285756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.285931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-13T18:35:33.286038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 20 totakecount 3 count 1 size 205086 from pos 0 cbcount 1
2025-10-13T18:35:33.286539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 21 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-13T18:35:33.286587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 38 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.286592Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.287385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.287394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.287473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 113 size: 511959
2025-10-13T18:35:33.287527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 1 messageNo: 113 size: 511959
2025-10-13T18:35:33.287581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 2 messageNo: 113 size: 511959
2025-10-13T18:35:33.287635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 3 messageNo: 113 size: 511959
2025-10-13T18:35:33.287681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 4 messageNo: 113 size: 205040
2025-10-13T18:35:33.287687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 4 messageNo: 113 size 205040 offset: -1
2025-10-13T18:35:33.287710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.287713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.287743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18
2025-10-13T18:35:33.287769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.287791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.290562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 58
2025-10-13T18:35:33.294047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.296396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.297688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.297712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.297795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 115 size: 511959
2025-10-13T18:35:33.297847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 1 messageNo: 115 size: 511959
2025-10-13T18:35:33.297908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 2 messageNo: 115 size: 511959
2025-10-13T18:35:33.297970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 3 messageNo: 115 size: 511959
2025-10-13T18:35:33.298040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 4 messageNo: 115 size: 205040
2025-10-13T18:35:33.298047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 4 messageNo: 115 size 205040 offset: -1
2025-10-13T18:35:33.298070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.298076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.298086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.296727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.297140Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 52 Result { Offset: 18 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 19 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532741 CreateTimestampMS: 1760380532716 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 20 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532775 CreateTimestampMS: 1760380532731 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 21 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1760380532779 CreateTimestampMS: 1760380532738 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 1 BlobsFromCache: 0 SizeLag: 16182998 RealReadOffset: 20 WaitQuotaTimeMs: 0 EndOffset: 52 StartOffset: 0 } Cookie: 18 }
2025-10-13T18:35:33.298168Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 21 endOffset 52
2025-10-13T18:35:33.298190Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 52 ReadOffset 21 ReadGuid 610fd145-4bc239c5-11ae10ee-6b3d882c has messages 1
2025-10-13T18:35:33.298107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.298124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 59
2025-10-13T18:35:33.298230Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 21, endOffset# 52, WTime# 1760380532779, sizeLag# 16182998
2025-10-13T18:35:33.298237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.298241Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1TEvPartitionReady. Aval parts: 0
2025-10-13T18:35:33.298256Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 read done: guid# 610fd145-4bc239c5-11ae10ee-6b3d882c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758905
2025-10-13T18:35:33.298267Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 response to read: guid# 610fd145-4bc239c5-11ae10ee-6b3d882c
2025-10-13T18:35:33.301242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.301484Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 Process answer. Aval parts: 1
2025-10-13T18:35:33.301666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.304236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.304258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.304365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 117 size: 511959
2025-10-13T18:35:33.304436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 1 messageNo: 117 size: 511959
2025-10-13T18:35:33.304513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 2 messageNo: 117 size: 511959
2025-10-13T18:35:33.304584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 3 messageNo: 117 size: 511959
2025-10-13T18:35:33.304640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 4 messageNo: 117 size: 205040
2025-10-13T18:35:33.304645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 4 messageNo: 117 size 205040 offset: -1
2025-10-13T18:35:33.304677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.304680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.304691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.304713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.304729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 60
2025-10-13T18:35:33.305172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.307619Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Got ReadResponse, serverBytesSize = 6758905, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234617
2025-10-13T18:35:33.307730Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (18-18)
2025-10-13T18:35:33.307741Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 6758905 to budget
2025-10-13T18:35:33.307747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.308090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.309189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.310777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.310796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.310887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 119 size: 511959
2025-10-13T18:35:33.310943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 1 messageNo: 119 size: 511959
2025-10-13T18:35:33.311007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 2 messageNo: 119 size: 511959
2025-10-13T18:35:33.311076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 3 messageNo: 119 size: 511959
2025-10-13T18:35:33.311135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 4 messageNo: 119 size: 205040
2025-10-13T18:35:33.311140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 4 messageNo: 119 size 205040 offset: -1
2025-10-13T18:35:33.311179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.311183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.311197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 4 from KV. Status 1
2025-10-13T18:35:33.311200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:35:33.311203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-13T18:35:33.311212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 43 count 4 size 7988760 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.311217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 47 count 1 size 1741189 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.311306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-13T18:35:33.311313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 43 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-13T18:35:33.311318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 39 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-13T18:35:33.311322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 47 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-13T18:35:33.311543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.311569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.311583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 36 size 8295660 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.311586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 39 size 7476729 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.311589Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.311613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:33.311622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.311792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-13T18:35:33.312126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-13T18:35:33.312146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000039_00003_0000000004_00014 new key d0000000000_00000000000000000039_00003_0000000004_00014 size 7988760 WTime 1760380533311
2025-10-13T18:35:33.312506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 44 partNo 4 FormedBlobsCount 1 NewHead: Offset 43 PartNo 1 PackedSize 1741199 count 1 nextOffset 44 batches 4
2025-10-13T18:35:33.312543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-13T18:35:33.313077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-13T18:35:33.313338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-13T18:35:33.313577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-13T18:35:33.313898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-13T18:35:33.314512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 1 PackedSize 3994397 count 2 nextOffset 45 batches 8
2025-10-13T18:35:33.314524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-13T18:35:33.314867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-13T18:35:33.315156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-13T18:35:33.315382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-13T18:35:33.315685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-13T18:35:33.316467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 43 PartNo 1 PackedSize 6247595 count 3 nextOffset 46 batches 12
2025-10-13T18:35:33.316477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-13T18:35:33.316651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-13T18:35:33.316830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-13T18:35:33.317002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-13T18:35:33.317093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-13T18:35:33.318947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 47 partNo 4 result is x0000000000_00000000000000000043_00001_0000000003_00015 size 8295582
2025-10-13T18:35:33.318960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000043_00001_0000000003_00015 new key d0000000000_00000000000000000043_00001_0000000003_00015 size 8295582 WTime 1760380533318
2025-10-13T18:35:33.318992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 47 partNo 4 FormedBlobsCount 1 NewHead: Offset 46 PartNo 4 PackedSize 205118 count 1 nextOffset 47 batches 1
2025-10-13T18:35:33.319242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-13T18:35:33.319252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.319469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-13T18:35:33.319686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-13T18:35:33.319882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-13T18:35:33.320431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-13T18:35:33.321328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 4 PackedSize 2458316 count 2 nextOffset 48 batches 5
2025-10-13T18:35:33.321362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.321520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-13T18:35:33.321669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-13T18:35:33.321822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-13T18:35:33.321975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-13T18:35:33.322044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-13T18:35:33.322527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 4 PackedSize 4711514 count 3 nextOffset 49 batches 9
2025-10-13T18:35:33.322536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.322660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-13T18:35:33.322783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-13T18:35:33.322908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-13T18:35:33.323028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-13T18:35:33.323235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-13T18:35:33.323729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 4 PackedSize 6964712 count 4 nextOffset 50 batches 13
2025-10-13T18:35:33.323737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-13T18:35:33.323882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 1
2025-10-13T18:35:33.324265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 2
2025-10-13T18:35:33.326601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 51 partNo 2 result is x0000000000_00000000000000000046_00004_0000000004_00014 size 7988738
2025-10-13T18:35:33.326733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 3
2025-10-13T18:35:33.326806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 4
2025-10-13T18:35:33.326820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000046_00004_0000000004_00014 new key d0000000000_00000000000000000046_00004_0000000004_00014 size 7988738 WTime 1760380533326
2025-10-13T18:35:33.327026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 51 partNo 4 FormedBlobsCount 1 NewHead: Offset 50 PartNo 2 PackedSize 1229172 count 1 nextOffset 51 batches 3
2025-10-13T18:35:33.327093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 50,1 HeadOffset 39 endOffset 43 curOffset 51 d0000000000_00000000000000000050_00002_0000000001_00002| size 1229162 WTime 1760380533327
2025-10-13T18:35:33.327303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 61
2025-10-13T18:35:33.327532Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.327544Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 43 partNo 1 count 3 size 8295582
2025-10-13T18:35:33.327548Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 46 partNo 4 count 4 size 7988738
2025-10-13T18:35:33.327553Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 50 partNo 2 count 1 size 1229162
2025-10-13T18:35:33.329622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 52 count 3 size 8295638 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.329634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 55 count 1 size 717135 actorID [2:7560776816243776721:2388]
2025-10-13T18:35:33.329651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.329676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-13T18:35:33.329689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-10-13T18:35:33.329709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 1, Offset: 52 is stored on disk
2025-10-13T18:35:33.329717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 2, Offset: 52 is stored on disk
2025-10-13T18:35:33.329726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 3, Offset: 52 is stored on disk
2025-10-13T18:35:33.329739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 4, Offset: 52 is stored on disk
2025-10-13T18:35:33.329747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-10-13T18:35:33.329755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 1, Offset: 53 is stored on disk
2025-10-13T18:35:33.329763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 2, Offset: 53 is stored on disk
2025-10-13T18:35:33.329772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 3, Offset: 53 is stored on disk
2025-10-13T18:35:33.329784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 4, Offset: 53 is stored on disk
2025-10-13T18:35:33.329795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-10-13T18:35:33.329806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 1, Offset: 54 is stored on disk
2025-10-13T18:35:33.329814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 2, Offset: 54 is stored on disk
2025-10-13T18:35:33.329820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 3, Offset: 54 is stored on disk
2025-10-13T18:35:33.329829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 4, Offset: 54 is stored on disk
2025-10-13T18:35:33.329836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-10-13T18:35:33.329844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 1, Offset: 55 is stored on disk
2025-10-13T18:35:33.329853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 2, Offset: 55 is stored on disk
2025-10-13T18:35:33.329873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 3, Offset: 55 is stored on disk
2025-10-13T18:35:33.329880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-13T18:35:33.329884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 4, Offset: 55 is stored on disk
2025-10-13T18:35:33.329918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.329939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.329941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-13T18:35:33.329961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-13T18:35:33.329971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 1
2025-10-13T18:35:33.329982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 2
2025-10-13T18:35:33.329987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 3
2025-10-13T18:35:33.329991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 4
2025-10-13T18:35:33.330681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 48 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:33.330692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 52 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-13T18:35:33.330698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 49 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-13T18:35:33.330704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 55 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-13T18:35:33.331081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 4 FormedBlobsCount 0 NewHead: Offset 56 PartNo 0 PackedSize 2253230 count 1 nextOffset 57 batches 5
2025-10-13T18:35:33.331147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-13T18:35:33.331156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 1
2025-10-13T18:35:33.331160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 2
2025-10-13T18:35:33.331164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 3
2025-10-13T18:35:33.331169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 4
2025-10-13T18:35:33.331970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 4 FormedBlobsCount 0 NewHead: Offset 56 PartNo 0 PackedSize 4506428 count 2 nextOffset 58 batches 9
2025-10-13T18:35:33.331994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-13T18:35:33.331999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 1
2025-10-13T18:35:33.332003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 2
2025-10-13T18:35:33.332008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 3
2025-10-13T18:35:33.332013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 4
2025-10-13T18:35:33.332755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 4 FormedBlobsCount 0 NewHead: Offset 56 PartNo 0 PackedSize 6759626 count 3 nextOffset 59 batches 13
2025-10-13T18:35:33.332775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-10-13T18:35:33.332781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 1
2025-10-13T18:35:33.332784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 2
2025-10-13T18:35:33.332787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 3
2025-10-13T18:35:33.332010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.334936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.335297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.351313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 60 partNo 3 result is x0000000000_00000000000000000056_00000_0000000003_00015? size 8295638
2025-10-13T18:35:33.351348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 4
2025-10-13T18:35:33.351364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000056_00000_0000000003_00015? new key d0000000000_00000000000000000056_00000_0000000003_00015? size 8295638 WTime 1760380533348
2025-10-13T18:35:33.351501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 4 FormedBlobsCount 1 NewHead: Offset 59 PartNo 3 PackedSize 717145 count 1 nextOffset 60 batches 2
2025-10-13T18:35:33.351520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.351627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 59,1 HeadOffset 56 endOffset 56 curOffset 60 d0000000000_00000000000000000059_00003_0000000001_00001? size 717135 WTime 1760380533348
2025-10-13T18:35:33.353323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.353357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.353367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.353375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.353764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 54 queued_in_partition_duration_ms: 28 }
2025-10-13T18:35:33.353783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 53
2025-10-13T18:35:33.353788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage got back to normal 20275218[B]
2025-10-13T18:35:33.354025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 54 queued_in_partition_duration_ms: 22 }
2025-10-13T18:35:33.354035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 54
2025-10-13T18:35:33.354082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 7 }
2025-10-13T18:35:33.354086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 55
2025-10-13T18:35:33.354106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 2 }
2025-10-13T18:35:33.354111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: acknoledged message 56
2025-10-13T18:35:33.353046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-13T18:35:33.353123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 53
2025-10-13T18:35:33.353147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 54
2025-10-13T18:35:33.353166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 55
2025-10-13T18:35:33.353182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 56
2025-10-13T18:35:33.353205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 48 size 2253220 cause it's been evicted from L2. Actual L1 size: 7
2025-10-13T18:35:33.353208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 49 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-13T18:35:33.353212Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-13T18:35:33.355792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.355800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.355878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 121 size: 511959
2025-10-13T18:35:33.355949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 1 messageNo: 121 size: 511959
2025-10-13T18:35:33.356010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 2 messageNo: 121 size: 511959
2025-10-13T18:35:33.356071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 3 messageNo: 121 size: 511959
2025-10-13T18:35:33.356126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 4 messageNo: 121 size: 205040
2025-10-13T18:35:33.356131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 4 messageNo: 121 size 205040 offset: -1
2025-10-13T18:35:33.356350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 63 to 63
2025-10-13T18:35:33.356805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: try to update token
2025-10-13T18:35:33.356823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Send 1 message(s) (0 left), first sequence number is 63
2025-10-13T18:35:33.356468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.356477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.356500Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-13T18:35:33.356518Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 56 partNo 0 count 3 size 8295638
2025-10-13T18:35:33.356525Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 59 partNo 3 count 1 size 717135
2025-10-13T18:35:33.356590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-13T18:35:33.356613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-13T18:35:33.356750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 62
2025-10-13T18:35:33.356779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-13T18:35:33.356807Z node 2 :PERSQUEUE ERROR: partition.cpp:2176: [72075186224037892][Partition][0][StateIdle] OnWrite topic 'rt3.dc1--test-topic' partition 0 commands are not processed at all, reason: Status: 128
ErrorReason: "KeyValue# 72075186224037892 OldKey# x0000000000_00000000000000000039_00003_0000000004_00014 does not exist in CmdRename(0) Marker# KV18"
Cookie: 1
2025-10-13T18:35:33.357373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.357103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_7608381465141185768_v1
2025-10-13T18:35:33.357121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:35:33.357127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:35:33.357130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:35:33.357134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:35:33.357139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117 requestId: <none> error: tablet will be restarted right now
2025-10-13T18:35:33.357409Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_7608381465141185768_v1
2025-10-13T18:35:33.357466Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357469Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357471Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357473Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357476Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357478Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357481Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357483Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357485Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357487Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357489Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357491Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357494Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357496Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357498Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357500Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357503Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357505Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357507Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357509Z node 2 :PERSQUEUE DEBUG: event_helpers.cpp:40: tablet 72075186224037892 topic 'rt3.dc1--test-topic' partition 0 error: Tablet is restarting, topic 'rt3.dc1--test-topic' (WriteResponses)
2025-10-13T18:35:33.357620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-13T18:35:33.357667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7560776814420904069:2470]
2025-10-13T18:35:33.358408Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (18-18)
2025-10-13T18:35:33.358431Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:33.358902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-13T18:35:33.358960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: status is not ok: tablet will be restarted right now sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0
2025-10-13T18:35:33.359148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0 is DEAD
2025-10-13T18:35:33.361310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-13T18:35:33.361322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session will restart in 0.007842s
2025-10-13T18:35:33.361351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: Do CDS request
2025-10-13T18:35:33.361358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Start write session. Will connect to endpoint: localhost:3763
2025-10-13T18:35:33.361597Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (19-19)
2025-10-13T18:35:33.361610Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-10-13T18:35:32.716000Z WriteTime: 2025-10-13T18:35:32.741000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:49910", "logtype": "unknown", "_ip": "ipv6:[::1]:49910" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.364559Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [e624e743f1d9fc5d] Result# TEvPutResult {Id# [72075186224037892:1:6:2:7:8295638:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-13T18:35:33.365852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 64 to 64
2025-10-13T18:35:33.365923Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-13T18:35:33.365881Z node 1 :BS_VDISK_PUT ERROR: blobstorage_skeleton.cpp:577: PDiskId# 1 VDISK[82000000:_:0:0:0]: (2181038080) TEvVPut: failed to pass the Hull check; id# [72075186224037892:1:6:2:8:717135:1] status# {Status# BLOCKED} Marker# BSVS03
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.370740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 65 to 65
2025-10-13T18:35:33.371279Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (19-19)
2025-10-13T18:35:33.371299Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-13T18:35:33.371357Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (20-20)
2025-10-13T18:35:33.371377Z :DEBUG: [/Root] [/Root] [67eb8acd-1b07b663-67bcbd3d-485dfa28] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-10-13T18:35:32.731000Z WriteTime: 2025-10-13T18:35:32.775000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:49910", "server": "ipv6:[::1]:49910", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-13T18:35:33.373622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-13T18:35:33.374379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-13T18:35:33.374605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-13T18:35:33.374609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-13T18:35:33.374621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-13T18:35:33.374682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-13T18:35:33.374724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7560776820538744382:2421]
2025-10-13T18:35:33.375315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-13T18:35:33.375623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write 1 messages with Id from 66 to 66
2025-10-13T18:35:33.375649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-13T18:35:33.375699Z :NOTICE: [/Invalid] [/Invalid] [72b2b90c-e9d4b570-481ab3e8-5894abe8] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:3763" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:3763. " }
2025-10-13T18:35:33.375897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-13T18:35:33.375964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-13T18:35:33.376476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:35:33.376568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-13T18:35:33.376583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-13T18:35:33.376489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-13T18:35:33.376575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:35:33.376576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:35:33.376577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:35:33.376578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:35:33.376579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:35:33.376580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:35:33.376581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:35:33.376582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:35:33.376584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:35:33.376585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-13T18:35:33.376586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000003_00015
2025-10-13T18:35:33.376587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000039_00003_0000000004_00013|
2025-10-13T18:35:33.376588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.376589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.376590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[14]: d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.376592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[15]: d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.376592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[16]: d0000000000_00000000000000000051_00000_0000000001_00004?
2025-10-13T18:35:33.376593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[17]: d0000000000_00000000000000000052_00000_0000000003_00015?
2025-10-13T18:35:33.376595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[18]: d0000000000_00000000000000000055_00003_0000000001_00001?
2025-10-13T18:35:33.376600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:35:33.376610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:35:33.376615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:35:33.376620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:35:33.376623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:35:33.376627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:35:33.376630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:35:33.376634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:35:33.376637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:35:33.376641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-13T18:35:33.376645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00015
2025-10-13T18:35:33.376649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00003_0000000004_00013|
2025-10-13T18:35:33.376654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.376657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.376661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.376665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.376669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000051_00000_0000000001_00004?
2025-10-13T18:35:33.376672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000052_00000_0000000003_00015?
2025-10-13T18:35:33.376676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000055_00003_0000000001_00001?
2025-10-13T18:35:33.376685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:35:33.376693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-13T18:35:33.376699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:35:33.376704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-13T18:35:33.376708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:35:33.376714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-13T18:35:33.376718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:35:33.376723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-13T18:35:33.376727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:35:33.376732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-13T18:35:33.376736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:35:33.376741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-13T18:35:33.376746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:35:33.376751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-13T18:35:33.376755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:35:33.376760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-13T18:35:33.376764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:35:33.376769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-13T18:35:33.376774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-13T18:35:33.376779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988778 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-13T18:35:33.376783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00015
2025-10-13T18:35:33.376788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 8295660 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00015
2025-10-13T18:35:33.376792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00003_0000000004_00013|
2025-10-13T18:35:33.376797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 4 size 7476729 so 0 eo 43 d0000000000_00000000000000000039_00003_0000000004_00013|
2025-10-13T18:35:33.376802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.376810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 43 count 4 size 7988760 so 0 eo 47 d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.376814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.376818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 47 count 1 size 1741189 so 0 eo 48 d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.376824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.376829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 48 count 1 size 2253220 so 0 eo 49 d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.376833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.376838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 49 count 2 size 4506418 so 0 eo 51 d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.376843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000051_00000_0000000001_00004?
2025-10-13T18:35:33.376847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 51 count 1 size 2253220 so 0 eo 52 d0000000000_00000000000000000051_00000_0000000001_00004?
2025-10-13T18:35:33.376851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000052_00000_0000000003_00015?
2025-10-13T18:35:33.376856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 52 count 3 size 8295638 so 0 eo 55 d0000000000_00000000000000000052_00000_0000000003_00015?
2025-10-13T18:35:33.376860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000055_00003_0000000001_00001?
2025-10-13T18:35:33.376866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 55 count 1 size 717135 so 0 eo 56 d0000000000_00000000000000000055_00003_0000000001_00001?
2025-10-13T18:35:33.376912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-13T18:35:33.376815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-13T18:35:33.376844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:49910
2025-10-13T18:35:33.376849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:49910 proto=v1  topic=test-topic durationSec=0
2025-10-13T18:35:33.376853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-13T18:35:33.377315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-13T18:35:33.377344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-13T18:35:33.377350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-13T18:35:33.377352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-13T18:35:33.377357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7560776818715871598:2481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-13T18:35:33.377893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7560776818715871598:2481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-13T18:35:33.380507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7560776818715871598:2481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-13T18:35:33.387762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7560776818715871598:2481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-13T18:35:33.387778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7560776818715871598:2481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-13T18:35:33.387785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7560776818715871598:2481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-13T18:35:33.387794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-13T18:35:33.389599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:916: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 39 endOffset 56 key 39,4 valuesize 7476729 expected 7476729
2025-10-13T18:35:33.391541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-13T18:35:33.391546Z node 2 :PERSQUEUE INFO: partition_init.cpp:965: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-13T18:35:33.391548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-13T18:35:33.391552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-13T18:35:33.391558Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7560776820538744382:2421]
2025-10-13T18:35:33.391571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 56 Head Offset 56 PartNo 0 PackedSize 0 count 0 nextOffset 56 batches 0
SYNC INIT sourceId  src_id seqNo 56 offset 55
SYNC INIT DATA KEY: d0000000000_00000000000000000043_00003_0000000004_00014? size 7988760
SYNC INIT DATA KEY: d0000000000_00000000000000000047_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000048_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000049_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000051_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000052_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000055_00003_0000000001_00001? size 717135
2025-10-13T18:35:33.391587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4310: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-13T18:35:33.391589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.391592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.391594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.391607Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 56 offset: 55 MaxOffset: 56
2025-10-13T18:35:33.391611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-13T18:35:33.391615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-13T18:35:33.391699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.391703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.391704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.391707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.391709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 16489587 bytes
2025-10-13T18:35:33.391778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-13T18:35:33.391781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000043_00003_0000000004_00014?
2025-10-13T18:35:33.391792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000047_00001_0000000001_00003?
2025-10-13T18:35:33.391802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-13T18:35:33.391821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000049_00000_0000000002_00008?
2025-10-13T18:35:33.391829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-13T18:35:33.391848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 43 partno 3 count 4 parts_count 14 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.391850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 47 partno 1 count 1 parts_count 3 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.391852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 48 partno 0 count 1 parts_count 4 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.391855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 49 partno 0 count 2 parts_count 8 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.391863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-13T18:35:33.391869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 43 partno 3 count 4 parts_count 14
2025-10-13T18:35:33.391872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 47 partno 1 count 1 parts_count 3
2025-10-13T18:35:33.391874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 48 partno 0 count 1 parts_count 4
2025-10-13T18:35:33.391876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 49 partno 0 count 2 parts_count 8
2025-10-13T18:35:33.391877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776818715871632:2481], now have 1 active actors on pipe
2025-10-13T18:35:33.391883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776818715871569:2423], now have 1 active actors on pipe
2025-10-13T18:35:33.391889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 56 max time lag 0ms effective offset 0
2025-10-13T18:35:33.391902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 56
2025-10-13T18:35:33.391904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-13T18:35:33.391954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.391961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-13T18:35:33.392169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-13T18:35:33.392808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-13T18:35:33.392838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-13T18:35:33.393002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.393015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.393052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|726126a4-cf31aaf9-a56e80af-b006c0b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-13T18:35:33.393065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-13T18:35:33.393071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-13T18:35:33.393073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-13T18:35:33.393082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-13T18:35:33.393098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-13T18:35:33.393116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:33.393347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.393354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.393370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-13T18:35:33.393506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 56 sessionId: src_id|726126a4-cf31aaf9-a56e80af-b006c0b0_0
2025-10-13T18:35:33.393908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|760c645a-2980efda-ed0c49f7-e97dfb53_0] Write session established. Init response: last_sequence_number: 56 session_id: "src_id|726126a4-cf31aaf9-a56e80af-b006c0b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-13T18:35:33.397254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|726126a4-cf31aaf9-a56e80af-b006c0b0_0] Write session: try to update token
2025-10-13T18:35:33.397272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|726126a4-cf31aaf9-a56e80af-b006c0b0_0] Send 10 message(s) (0 left), first sequence number is 57
2025-10-13T18:35:33.449810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|726126a4-cf31aaf9-a56e80af-b006c0b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-13T18:35:33.458603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 21 EndOffset 52 InitDone 1 WaitForData 0, pipe: [1:7560776818715871639:2470]
2025-10-13T18:35:33.461259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-13T18:35:33.468289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_7608381465141185768_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7560776818715871639:2470]
2025-10-13T18:35:33.483554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7560776818715871639:2470], now have 1 active actors on pipe
2025-10-13T18:35:33.483586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-13T18:35:33.483593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-13T18:35:33.483627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-13T18:35:33.483632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-13T18:35:33.483635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-13T18:35:33.483639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-13T18:35:33.483646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-13T18:35:33.483653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 43 count 4 size 7988760 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.483658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 47 count 1 size 1741189 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.483664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 48 count 1 size 2253220 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.483668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 49 count 2 size 4506418 actorID [2:7560776820538744375:2421]
2025-10-13T18:35:33.484484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 43 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-13T18:35:33.484493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 47 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-13T18:35:33.484499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 48 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:33.484504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 51 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-13T18:35:33.484509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-13T18:35:33.484512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 49 partno 0 count 2 parts 8 suffix '63' size 4506418
VERIFY failed (2025-10-13T18:35:33.493756Z): Something went wrong
  ydb/core/persqueue/pqtablet/partition/partition_compaction.cpp:447
  BlobsForCompactionWereRead(): requirement false failed
2025-10-13T18:35:33.493552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-13T18:35:33.493578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-13T18:35:33.493736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-13T18:35:33.493750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:446: [72075186224037892][Partition][0][StateIdle] Can't append blob for key d0000000000_00000000000000000043_00003_0000000004_00014?
NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char, std::__y1::char_traits<char>>, char const*, unsigned long)+423 (0x14A0B997)
NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...)+263 (0x14A02247)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+7690 (0x2455809A)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+5681 (0x24402EB1)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15618778)
NActors::TExecutorThread::Execute(NActors::TMailbox*, bool)+3317 (0x1565C135)
??+0 (0x15660243)
NActors::TExecutorThread::ProcessExecutorPool()+657 (0x1565FE51)
NActors::TExecutorThread::ThreadProc()+191 (0x15660A3F)
??+0 (0x14A0D7FD)
??+0 (0x7F7A9128DAC3)
??+0 (0x7F7A9131F8C0)
