2025-10-15T02:28:02.186495Z :PropagateSessionClosed INFO: Random seed for debugging is 1760495282186487
2025-10-15T02:28:02.762998Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7561269661565587506:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T02:28:02.763370Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-15T02:28:02.770271Z node 2 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639258 Duration# 0.006662s
2025-10-15T02:28:02.887477Z node 1 :BS_NODE WARN: {NWDC01@distconf.cpp:397} StateFunc too long Type# 268639238 Duration# 0.011663s
2025-10-15T02:28:02.930482Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-15T02:28:03.046186Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-15T02:28:03.061707Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/c56l/000256/r3tmp/tmpPFVnG1/pdisk_1.dat
2025-10-15T02:28:03.200757Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T02:28:03.202261Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T02:28:03.202306Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-15T02:28:03.368560Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T02:28:03.455436Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T02:28:03.455849Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T02:28:03.469170Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T02:28:03.480674Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-15T02:28:03.481666Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-15T02:28:03.481687Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-15T02:28:03.498423Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-15T02:28:03.500979Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-15T02:28:03.502941Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 29296, node 1
2025-10-15T02:28:03.706052Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7561269665860555583:2309], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T02:28:03.707288Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T02:28:03.707424Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7561269665860555593:2311], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T02:28:03.707434Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T02:28:03.710449Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7561269665860555597:2313], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-15T02:28:03.772269Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-15T02:28:03.850589Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T02:28:03.874763Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7561269665860555599:2314], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-10-15T02:28:03.973327Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T02:28:03.978691Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-15T02:28:04.035169Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/c56l/000256/r3tmp/yandexHE5a5K.tmp
2025-10-15T02:28:04.035925Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/c56l/000256/r3tmp/yandexHE5a5K.tmp
2025-10-15T02:28:04.042857Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/c56l/000256/r3tmp/yandexHE5a5K.tmp
2025-10-15T02:28:04.044739Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-15T02:28:04.061534Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-15T02:28:04.086137Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7561269665860555694:2520] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 5], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-15T02:28:04.760029Z INFO: TTestServer started on Port 9540 GrpcPort 29296
TClient is connected to server localhost:9540
PQClient connected to localhost:29296
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 5
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 5
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 4
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: true
  }
  Children {
    Name: ".metadata"
    PathId: 2
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 281474976720657
    CreateStep: 1760495283869
    ParentPathId: 1
    PathState: EPathStateCreate
    Owner: "metadata@system"
    ACL: ""
    ChildrenExist: true
  }
  Children {
    Name: ".sys"
    PathId: 184467440737...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-15T02:28:05.854017Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720659:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-15T02:28:06.034978Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [2:7561269675000477798:2303], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T02:28:06.040172Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NWY3ZDc0MTQtNWVkMzkwMzktZDgyNjU0YjQtZGI4Njg3YzA=, ActorId: [2:7561269675000477773:2297], ActorState: ExecuteState, TraceId: 01k7jv4d3w2ryg8db57vddq53a, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T02:28:06.039801Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:570: Compilation failed, self: [1:7561269670155523037:2324], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-15T02:28:06.054010Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=YTc4NzZkMTItYTdkNmVjY2QtZmE0NWQ1ZGQtMWFiYjkwNWU=, ActorId: [1:7561269665860555581:2308], ActorState: ExecuteState, TraceId: 01k7jv4bfc87hzx7f34z26c17b, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-15T02:28:06.092088Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T02:28:06.093864Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-15T02:28:06.336518Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T02:28:06.654187Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-15T02:28:06.716586Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:29296", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-15T02:28:06.915128Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k7jv4ef9f42xadmq53fpkv1x, Database: , SessionId: ydb://session/3?node_id=1&id=ZTdkYjY3MWMtNThhYmMzNjUtNzJlYWVjZjQtOTQ5ODc0NDU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7561269678745458234:2978] 
2025-10-15T02:28:07.757696Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7561269661565587506:2077];send_to=[0:7307199536658146131:7762515];
2025-10-15T02:28:07.757751Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-15T02:28:12.597447Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720673:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:29296
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T02:28:12.622109Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29296
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720674
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-15T02:28:12.646722Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7561269704515262465:3266] connected; active server actors: 1
2025-10-15T02:28:12.649228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-15T02:28:12.649916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:940: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-15T02:28:12.658668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-15T02:28:12.677047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T02:28:12.683829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T02:28:12.684530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-15T02:28:12.684871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T02:28:12.685053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-15T02:28:12.684123Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720675. Ctx: { TraceId: 01k7jv4m6t3tewcwf0m5410xz7, Database: , SessionId: ydb://session/3?node_id=1&id=YjJkNzQyZS1jNTU3MjI5LTgwN2ExODhlLTUxOWI1NjE3, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-15T02:28:12.685700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-15T02:28:12.685808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269704515262461:3263], now have 1 active actors on pipe
2025-10-15T02:28:12.685818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269704515262488:2450], now have 1 active actors on pipe
2025-10-15T02:28:12.686914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T02:28:12.692394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-15T02:28:12.695968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269704515262555:3325], now have 1 active actors on pipe
2025-10-15T02:28:12.696315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T02:28:12.697503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T02:28:12.698679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T02:28:12.698808Z node 2 :PERSQUEUE DEBUG: partition.cpp:1281: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-15T02:28:12.698991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T02:28:12.699404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561269705065249388:2400]
2025-10-15T02:28:12.700852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T02:28:12.700864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T02:28:12.700892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7561269705065249388:2400]
2025-10-15T02:28:12.700934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-15T02:28:12.701710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4311: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-15T02:28:12.701929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:12.702069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.702077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T02:28:12.702080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T02:28:12.702083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.702084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.702086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2356: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-15T02:28:12.702111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T02:28:12.702782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T02:28:12.702970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:12.704748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T02:28:12.704930Z node 2 :PERSQUEUE DEBUG: partition.cpp:1385: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1760495292745, TxId 281474976720674
2025-10-15T02:28:12.704944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.704948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.705174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:12.705445Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:12.706348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:12.706499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:12.706513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:12.706516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.706518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:12.706524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:12.706669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-15T02:28:12.706694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T02:28:12.706751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T02:28:12.707994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T02:28:12.708019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-15T02:28:12.708665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-15T02:28:12.803967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:12.803983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.803986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:12.904281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:12.904296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:12.904299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.004654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.004672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.004676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.104989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.105005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.105008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720674
    CreateStep: 1760495292745
    ParentPathId: 6
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720674
    CreateStep: 1760495292745
    ParentPathId: 6
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:29296
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-15T02:28:13.198770Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1524: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-15T02:28:13.205300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.205317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.205319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.206714Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-15T02:28:13.206995Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-15T02:28:13.207043Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:29296
2025-10-15T02:28:13.210393Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T02:28:13.210598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T02:28:13.210616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-15T02:28:13.218172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-15T02:28:13.218593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:57268
2025-10-15T02:28:13.218609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57268 proto=v1  topic=test-topic durationSec=0
2025-10-15T02:28:13.218670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T02:28:13.219532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-15T02:28:13.219724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T02:28:13.219727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T02:28:13.219729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T02:28:13.219791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T02:28:13.220587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-15T02:28:13.273087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T02:28:13.273503Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810229948:2468] connected; active server actors: 1
2025-10-15T02:28:13.273530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-15T02:28:13.273536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-15T02:28:13.273920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810229948:2468] disconnected.
2025-10-15T02:28:13.273929Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810229948:2468] disconnected; active server actors: 1
2025-10-15T02:28:13.273933Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810229948:2468] disconnected no session
2025-10-15T02:28:13.300675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T02:28:13.300691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T02:28:13.300889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561269708810229913:2468] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-15T02:28:13.300916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T02:28:13.304540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269708810229971:2468], now have 1 active actors on pipe
2025-10-15T02:28:13.304800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T02:28:13.305183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.305196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.305671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.305674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.305677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.305801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-15T02:28:13.305808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.305906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.305909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T02:28:13.306105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.306119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T02:28:13.306376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:13.306808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.306817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.306971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:13.307245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0
2025-10-15T02:28:13.314009Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760495293313 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T02:28:13.314137Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T02:28:13.314332Z :INFO: [] MessageGroupId [src] SessionId [src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0] Write session: close. Timeout = 0 ms
2025-10-15T02:28:13.314339Z :INFO: [] MessageGroupId [src] SessionId [src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0] Write session will now close
2025-10-15T02:28:13.314343Z :DEBUG: [] MessageGroupId [src] SessionId [src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0] Write session: aborting
2025-10-15T02:28:13.314791Z :INFO: [] MessageGroupId [src] SessionId [src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0] Write session: gracefully shut down, all writes complete
2025-10-15T02:28:13.314799Z :DEBUG: [] MessageGroupId [src] SessionId [src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0] Write session: destroy
2025-10-15T02:28:13.318226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0 grpc read done: success: 0 data: 
2025-10-15T02:28:13.318245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0 grpc read failed
2025-10-15T02:28:13.318423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0
2025-10-15T02:28:13.318437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|cc03d331-8bbfb5c3-fc234b9a-fa774186_0 is DEAD
2025-10-15T02:28:13.318667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-15T02:28:13.321966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7561269708810229971:2468] destroyed
2025-10-15T02:28:13.322013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-15T02:28:13.322022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.322025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.322027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
>>> Ready to answer: ok
2025-10-15T02:28:13.381005Z :INFO: [/Root] [] [fba73f02-514b111a-2bcce29f-e990df48] Open read subsessions to databases: { name: dc1, endpoint: localhost:29296, path: /Root }, { name: dc2, endpoint: localhost:29296, path: /Invalid }
2025-10-15T02:28:13.390004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-15T02:28:13.390134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-15T02:28:13.391477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:29296
2025-10-15T02:28:13.392201Z :INFO: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] Starting read session
2025-10-15T02:28:13.392546Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] Starting single session
2025-10-15T02:28:13.406099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.406114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.406118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.412649Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.412664Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.412670Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T02:28:13.478952Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Successfully connected. Initializing session
2025-10-15T02:28:13.478883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T02:28:13.478913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-15T02:28:13.481412Z :INFO: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Starting read session
2025-10-15T02:28:13.481423Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Starting single session
2025-10-15T02:28:13.481451Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.481454Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.481458Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] Reconnecting session to cluster  in 0.000000s
2025-10-15T02:28:13.479961Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-15T02:28:13.479970Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-15T02:28:13.481886Z :ERROR: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. 
2025-10-15T02:28:13.481894Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.481896Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.482273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T02:28:13.482989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T02:28:13.483472Z :INFO: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:13.483128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:45414
2025-10-15T02:28:13.483155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45414 proto=v1  topic=test-topic durationSec=0
2025-10-15T02:28:13.483161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T02:28:13.483673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-15T02:28:13.483720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T02:28:13.483722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T02:28:13.483724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T02:28:13.483730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T02:28:13.484304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T02:28:13.484611Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T02:28:13.487080Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 read init: from# ipv6:[::1]:45414, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-15T02:28:13.488144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-15T02:28:13.488276Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810230013:2487] connected; active server actors: 1
2025-10-15T02:28:13.488366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-15T02:28:13.488372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T02:28:13.488476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1657: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810230013:2487] disconnected.
2025-10-15T02:28:13.488479Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1668: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810230013:2487] disconnected; active server actors: 1
2025-10-15T02:28:13.488482Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1693: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810230013:2487] disconnected no session
2025-10-15T02:28:13.488617Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 auth for : user
2025-10-15T02:28:13.489332Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Handle describe topics response
2025-10-15T02:28:13.489820Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 auth is DEAD
2025-10-15T02:28:13.490165Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 auth ok: topics# 1, initDone# 0
2025-10-15T02:28:13.490864Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 register session: topic# rt3.dc1--test-topic
2025-10-15T02:28:13.491437Z :INFO: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Got InitResponse. ReadSessionId: shared/user_1_1_8135371593314820448_v1
2025-10-15T02:28:13.491849Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-15T02:28:13.492314Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T02:28:13.493220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269708810230033:2487], now have 1 active actors on pipe
2025-10-15T02:28:13.493363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.493373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.493401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T02:28:13.493411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.493416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.493419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T02:28:13.493431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.493446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T02:28:13.493475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:13.493856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.493865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.493892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:13.494937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1760495293494 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T02:28:13.494964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|d5c04743-7e55f355-1229f494-ed55dae7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T02:28:13.491998Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7561269708810230029:2488] connected; active server actors: 1
2025-10-15T02:28:13.492014Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1704: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7561269708810230029:2488] session shared/user_1_1_8135371593314820448_v1
2025-10-15T02:28:13.492634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T02:28:13.492641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-15T02:28:13.492645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T02:28:13.492652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T02:28:13.493260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-15T02:28:13.493877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-15T02:28:13.493891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-15T02:28:13.493900Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_8135371593314820448_v1" (Sender=[1:7561269708810229992:2488], Pipe=[1:7561269708810230029:2488], Partitions=[], ActiveFamilyCount=0)
2025-10-15T02:28:13.494114Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-15T02:28:13.494255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-15T02:28:13.494513Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got read request: guid# ddd6d101-856a3ba3-4d644a90-5b2c122a
2025-10-15T02:28:13.494575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0
2025-10-15T02:28:13.494612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-15T02:28:13.494886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_8135371593314820448_v1" (Sender=[1:7561269708810229992:2488], Pipe=[1:7561269708810230029:2488], Partitions=[], ActiveFamilyCount=0)
2025-10-15T02:28:13.495196Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_8135371593314820448_v1" sender [1:7561269708810229992:2488] lock partition 0 for ReadingSession "shared/user_1_1_8135371593314820448_v1" (Sender=[1:7561269708810229992:2488], Pipe=[1:7561269708810230029:2488], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-15T02:28:13.495533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-15T02:28:13.495832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.001215s
2025-10-15T02:28:13.500612Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_8135371593314820448_v1" ClientId: "user" PipeClient { RawX1: 7561269708810230029 RawX2: 4503603922340280 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-15T02:28:13.501545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-15T02:28:13.502305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269708810230036:2494], now have 1 active actors on pipe
2025-10-15T02:28:13.502883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7561269708810230036:2494]
2025-10-15T02:28:13.503036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.503056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.503090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_8135371593314820448_v1 on pipe: [1:7561269708810230036:2494]
2025-10-15T02:28:13.503521Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_8135371593314820448_v1:1 with generation 1
2025-10-15T02:28:13.503813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.503829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.503832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T02:28:13.504583Z node 2 :PERSQUEUE DEBUG: partition.cpp:3708: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_8135371593314820448_v1
2025-10-15T02:28:13.504600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.504649Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:13.506050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:13.506827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:13.506834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-15T02:28:13.506862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:13.506881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.506884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.506889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.506897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:13.506910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-15T02:28:13.508328Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1760495293493 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-15T02:28:13.509124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-15T02:28:13.511429Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 sending to client partition status
2025-10-15T02:28:13.607218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.607231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.607234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.709823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.709881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.709883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.733631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 1 to 1
2025-10-15T02:28:13.786672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:13.786696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-15T02:28:13.803434Z :INFO: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-15T02:28:13.805759Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-15T02:28:13.805882Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-15T02:28:13.805903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-15T02:28:13.806604Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-15T02:28:13.810010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.810022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.810025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.842528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:13.873052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:13.873665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.873686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.874012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T02:28:13.874128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:13.877856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:13.877872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:13.879466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:13.879872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:13.879943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:13.880092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:13.880152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-15T02:28:13.880164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-15T02:28:13.880200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:13.880836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:13.881216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:13.881228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:13.882676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T02:28:13.883573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-15T02:28:13.883590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-15T02:28:13.883594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-15T02:28:13.883598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-15T02:28:13.887380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-15T02:28:13.887406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:13.887943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1760495293887
2025-10-15T02:28:13.890173Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:13.890191Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-15T02:28:13.910488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:13.946543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 2 to 2
2025-10-15T02:28:13.998318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:13.998343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-15T02:28:14.002728Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T02:28:14.003023Z :DEBUG: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.009164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.009199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.009223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.009230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.009240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-15T02:28:14.009245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.009251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-15T02:28:14.009253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.009257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-15T02:28:14.009259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.009263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-15T02:28:14.009269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.009273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-15T02:28:14.009289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.010161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T02:28:14.010177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T02:28:14.010183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.010186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.010189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.010201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.010233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-15T02:28:14.010273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T02:28:14.010299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-15T02:28:14.010308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T02:28:14.010336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.010390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.010371Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-15T02:28:14.010410Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-15T02:28:14.010476Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-15T02:28:14.010456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.010541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T02:28:14.010739Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-15T02:28:14.010749Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1TEvPartitionReady. Aval parts: 1
2025-10-15T02:28:14.010765Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 performing read request: guid# b84d1d9f-4c0503e9-767c152-78ee0c0c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T02:28:14.011009Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid b84d1d9f-4c0503e9-767c152-78ee0c0c
2025-10-15T02:28:14.013714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:14.013941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.014126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.014507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.014618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:14.014756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.014765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.014768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.014812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.014827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.014848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760495293883 queuesize 0 startOffset 0
2025-10-15T02:28:14.014887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-15T02:28:14.014915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-15T02:28:14.014924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T02:28:14.014934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.014952Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-15T02:28:14.014963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T02:28:14.014992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.015140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:14.015299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.015452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.015609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.015931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:14.015978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:14.023266Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495293882 CreateTimestampMS: 1760495293518 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-15T02:28:14.045506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.045977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.046540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.046589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.046623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-15T02:28:14.046736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.050407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 3 to 3
2025-10-15T02:28:14.050749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.050768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-15T02:28:14.049719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.049738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.049839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-15T02:28:14.049896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-15T02:28:14.049971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-15T02:28:14.050028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-15T02:28:14.050063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-15T02:28:14.050068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-15T02:28:14.050093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.050427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.050437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.050440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.050813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T02:28:14.050826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-15T02:28:14.050830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-15T02:28:14.050834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-15T02:28:14.050838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-15T02:28:14.059321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-15T02:28:14.059357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.059470Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-15T02:28:14.059499Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid b84d1d9f-4c0503e9-767c152-78ee0c0c has messages 1
2025-10-15T02:28:14.059482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00004? size 2253219 WTime 1760495294059
2025-10-15T02:28:14.060308Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 read done: guid# b84d1d9f-4c0503e9-767c152-78ee0c0c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-15T02:28:14.060326Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 response to read: guid# b84d1d9f-4c0503e9-767c152-78ee0c0c
2025-10-15T02:28:14.075336Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.075374Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 2253219
2025-10-15T02:28:14.082801Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 2 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-15T02:28:14.082815Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 2
2025-10-15T02:28:14.082503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 2253219 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.082835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.082543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.082576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.082575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.082584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.082597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-15T02:28:14.082602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.082607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-15T02:28:14.082609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.082614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-15T02:28:14.082616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.082621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-15T02:28:14.082628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.082633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-15T02:28:14.082695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.082697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.082700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.082716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.082737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-15T02:28:14.084718Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.085366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 125 queued_in_partition_duration_ms: 3 }
2025-10-15T02:28:14.085386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 1
2025-10-15T02:28:14.086077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 1 }
2025-10-15T02:28:14.086418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 2
2025-10-15T02:28:14.086766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.087136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.087341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.087372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.087412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-15T02:28:14.087492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.090104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 4 to 4
2025-10-15T02:28:14.090299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.090339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.090442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-15T02:28:14.090462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.090514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-15T02:28:14.090510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-15T02:28:14.090965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-15T02:28:14.091034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-15T02:28:14.091073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-15T02:28:14.091078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-15T02:28:14.091111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.091139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.091153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.091157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.091198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T02:28:14.091211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-15T02:28:14.091215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-15T02:28:14.091218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-15T02:28:14.091222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-15T02:28:14.091702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 2253229 count 1 nextOffset 3 batches 5
2025-10-15T02:28:14.091717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.091836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00004? size 2253219 WTime 1760495294091
2025-10-15T02:28:14.092140Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.092162Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 2253219
2025-10-15T02:28:14.104871Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.105468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.115148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.117020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 5 to 5
2025-10-15T02:28:14.119368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.119392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-15T02:28:14.119904Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.123448Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Process answer. Aval parts: 0
2025-10-15T02:28:14.123605Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 2, WTime# 1760495293882, sizeLag# 2253219
2025-10-15T02:28:14.123607Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1TEvPartitionReady. Aval parts: 1
2025-10-15T02:28:14.124091Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-15T02:28:14.124466Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-15T02:28:14.124539Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 2252976 to budget
2025-10-15T02:28:14.125354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 6 to 6
2025-10-15T02:28:14.125906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.126196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.126222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.126264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-15T02:28:14.126363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.128064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.133127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.135191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.135219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.135316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-15T02:28:14.135383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-15T02:28:14.135446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-15T02:28:14.135505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-15T02:28:14.135546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-15T02:28:14.135558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-15T02:28:14.135620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.135629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.135644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.135671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.135865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-15T02:28:14.136110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.137131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 2253219 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.137168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.137185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.137195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.137215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.137230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-15T02:28:14.137238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.137243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-15T02:28:14.137245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.137249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-15T02:28:14.137250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.137255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-15T02:28:14.137262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.137280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-15T02:28:14.137324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.137349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.137351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.137378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T02:28:14.137393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-15T02:28:14.137397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-15T02:28:14.137400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-15T02:28:14.137403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-15T02:28:14.137683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.137704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-15T02:28:14.137979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-15T02:28:14.138000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.138113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 3 endOffset 3 curOffset 4 d0000000000_00000000000000000003_00000_0000000001_00004? size 2253219 WTime 1760495294137
2025-10-15T02:28:14.138403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.138440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-15T02:28:14.138544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.139146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.139165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.139234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-15T02:28:14.139286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-15T02:28:14.139339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-15T02:28:14.139393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-15T02:28:14.139424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-15T02:28:14.139433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-15T02:28:14.139451Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.139471Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 1 size 2253219
2025-10-15T02:28:14.139485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.139510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.140081Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-15T02:28:14.140179Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:14.140191Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-15T02:28:14.140282Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T02:28:14.140296Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
2025-10-15T02:28:14.140436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.140513Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-15T02:28:14.140615Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got read request: guid# 64ee4e62-5a2cd502-802fc7b0-9f864266
2025-10-15T02:28:14.140644Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 performing read request: guid# 4f64ae-13bd6cc4-c2c12f2e-39e356c7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T02:28:14.140679Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 2 ClientCommitOffset 0 committedOffset 0 Guid 4f64ae-13bd6cc4-c2c12f2e-39e356c7
2025-10-15T02:28:14.140788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.140866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.140876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.140892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.140894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.140937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-15T02:28:14.140963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 1 size 524288 endOffset 3 max time lag 0ms effective offset 1
2025-10-15T02:28:14.141001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 2253219 count 1 last offset 1, current partition end offset: 3
2025-10-15T02:28:14.141009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-15T02:28:14.141014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.141020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.141040Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-15T02:28:14.141052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.141060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-15T02:28:13.518000Z WriteTime: 2025-10-15T02:28:13.882000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:45414", "_ip": "ipv6:[::1]:45414", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:14.141306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:14.141459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.141618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.141768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.141931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 46 }
2025-10-15T02:28:14.141940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 3
2025-10-15T02:28:14.141965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:14.142012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T02:28:14.144190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.144209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.144279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-15T02:28:14.144338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-15T02:28:14.144400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-15T02:28:14.144456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-15T02:28:14.144636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-15T02:28:14.144728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-15T02:28:14.144770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.144800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.145032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 7 to 7
2025-10-15T02:28:14.145315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.145330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-15T02:28:14.146182Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 3 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294050 CreateTimestampMS: 1760495293807 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 1 WaitQuotaTimeMs: 0 EndOffset: 3 StartOffset: 0 } Cookie: 1 }
2025-10-15T02:28:14.147609Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.147947Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 2 endOffset 3
2025-10-15T02:28:14.147978Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 3 ReadOffset 2 ReadGuid 4f64ae-13bd6cc4-c2c12f2e-39e356c7 has messages 1
2025-10-15T02:28:14.148014Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 2, endOffset# 3, WTime# 1760495294050, sizeLag# 2253329
2025-10-15T02:28:14.148021Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1TEvPartitionReady. Aval parts: 0
2025-10-15T02:28:14.148038Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 read done: guid# 4f64ae-13bd6cc4-c2c12f2e-39e356c7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252977
2025-10-15T02:28:14.148056Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 response to read: guid# 4f64ae-13bd6cc4-c2c12f2e-39e356c7
2025-10-15T02:28:14.146281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 2253219 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.146304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.146321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.146334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.146341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.146352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-15T02:28:14.146356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.146361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-15T02:28:14.146362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.146366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-15T02:28:14.146368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.146372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-15T02:28:14.146379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.146383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-15T02:28:14.146435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.146449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.146452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:14.146477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T02:28:14.146499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-15T02:28:14.146503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-15T02:28:14.146506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-15T02:28:14.146509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-15T02:28:14.151336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 8 to 8
2025-10-15T02:28:14.151315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-15T02:28:14.151356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T02:28:14.151372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-15T02:28:14.151378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-15T02:28:14.151383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-15T02:28:14.151385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-15T02:28:14.156508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-15T02:28:14.157139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.157288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 4,2 HeadOffset 4 endOffset 4 curOffset 6 d0000000000_00000000000000000004_00000_0000000002_00008? size 4506416 WTime 1760495294157
2025-10-15T02:28:14.166737Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Process answer. Aval parts: 1
2025-10-15T02:28:14.168077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.170782Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Got ReadResponse, serverBytesSize = 2252977, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728689
2025-10-15T02:28:14.170919Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-15T02:28:14.170946Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 2252977 to budget
2025-10-15T02:28:14.191123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.201008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.201029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-15T02:28:14.203184Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-15T02:28:14.203202Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:14.203214Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252977, ReadSizeServerDelta = -1728689
2025-10-15T02:28:14.203300Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T02:28:14.203313Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-15T02:28:13.807000Z WriteTime: 2025-10-15T02:28:14.050000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:45414", "_ip": "ipv6:[::1]:45414", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:14.217467Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252977 } }
2025-10-15T02:28:14.217574Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got read request: guid# f74a651a-75f74dda-5fd81c98-303b0127
2025-10-15T02:28:14.217600Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 performing read request: guid# 4fa881e7-8c3f6b9d-6b49de1a-e794e713, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T02:28:14.217640Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 2 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid 4fa881e7-8c3f6b9d-6b49de1a-e794e713
2025-10-15T02:28:14.218509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 9 to 9
2025-10-15T02:28:14.220598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.220620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-15T02:28:14.221676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-15T02:28:14.221693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-15T02:28:14.221696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-15T02:28:14.221699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-15T02:28:14.221702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 9012876 bytes
2025-10-15T02:28:14.221776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-15T02:28:14.221819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.222005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.222112Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.222444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.224570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.224852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 1 }
2025-10-15T02:28:14.224871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 4
2025-10-15T02:28:14.224919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.221960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.221989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.222012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.222015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.222026Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.222042Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 4 partNo 0 count 2 size 4506416
2025-10-15T02:28:14.222060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-15T02:28:14.222098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-15T02:28:14.222108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000001_00004?
2025-10-15T02:28:14.222123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000002_00000_0000000001_00004?
2025-10-15T02:28:14.222141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000001_00004?
2025-10-15T02:28:14.222151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-15T02:28:14.222220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.222223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.222227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.222230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.222238Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 4 blobs are from cache.
2025-10-15T02:28:14.222263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-15T02:28:14.222262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.222268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.222271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.222275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.222309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:14.222389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.222535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-15T02:28:14.222686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-15T02:28:14.222819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-15T02:28:14.222981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-15T02:28:14.223050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-15T02:28:14.223576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-15T02:28:14.223588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.223722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-15T02:28:14.223879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-15T02:28:14.224224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-15T02:28:14.224363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-15T02:28:14.224437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-15T02:28:14.226137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 10 to 10
2025-10-15T02:28:14.226273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-15T02:28:14.226291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.226455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-15T02:28:14.226628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-15T02:28:14.226784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-15T02:28:14.227335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-15T02:28:14.227402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-15T02:28:14.251431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.251456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-15T02:28:14.253588Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.273197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-15T02:28:14.273235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.273384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-15T02:28:14.273540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-15T02:28:14.273759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-15T02:28:14.274357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-15T02:28:14.353601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-15T02:28:14.358463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-15T02:28:14.358496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1760495294358
2025-10-15T02:28:14.358660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-15T02:28:14.359677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,1 HeadOffset 0 endOffset 0 curOffset 4 d0000000000_00000000000000000003_00003_0000000001_00001| size 717134 WTime 1760495294359
2025-10-15T02:28:14.359845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 2 count 1 size 524288 endOffset 4 max time lag 0ms effective offset 2
2025-10-15T02:28:14.359870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 2253219 count 1 last offset 2, current partition end offset: 4
2025-10-15T02:28:14.359874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-15T02:28:14.399144Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:1:0
2025-10-15T02:28:14.399174Z :INFO: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1008 BytesRead: 4505602 MessagesRead: 2 BytesReadCompressed: 4505602 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-15T02:28:14.399109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.399137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.399266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-15T02:28:14.399341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-15T02:28:14.399412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-15T02:28:14.399486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-15T02:28:14.399531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-15T02:28:14.399536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-15T02:28:14.399607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.399612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.399653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.399660Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.399685Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-15T02:28:14.399693Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 1 size 717134
2025-10-15T02:28:14.399709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 2 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.400848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.399723Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-15T02:28:14.399738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.399759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.399763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.399979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T02:28:14.400165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:14.400313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.400449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.400608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.400706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:14.400748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-15T02:28:14.400789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 2
2025-10-15T02:28:14.401925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 4 count 2 size 4506416 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.401950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.401971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 11 to 11
2025-10-15T02:28:14.401970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.401972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T02:28:14.401982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.401991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-15T02:28:14.401996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-15T02:28:14.402002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-15T02:28:14.402007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-15T02:28:14.402017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-15T02:28:14.402023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-15T02:28:14.402029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-15T02:28:14.402037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-15T02:28:14.402043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-15T02:28:14.402050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.402053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-15T02:28:14.402094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.402108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.402115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.402141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T02:28:14.402157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-15T02:28:14.402165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-15T02:28:14.402167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-15T02:28:14.402170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-15T02:28:14.406200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.406033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 6 PartNo 0 PackedSize 2253229 count 1 nextOffset 7 batches 5
2025-10-15T02:28:14.406066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.406201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 6,1 HeadOffset 6 endOffset 6 curOffset 7 d0000000000_00000000000000000006_00000_0000000001_00004? size 2253219 WTime 1760495294406
2025-10-15T02:28:14.407102Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 4 Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294091 CreateTimestampMS: 1760495294009 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 2253329 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 4 StartOffset: 0 } Cookie: 2 }
2025-10-15T02:28:14.407430Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 4
2025-10-15T02:28:14.407452Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 4 ReadOffset 3 ReadGuid 4fa881e7-8c3f6b9d-6b49de1a-e794e713 has messages 1
2025-10-15T02:28:14.407481Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 4, WTime# 1760495294091, sizeLag# 2253329
2025-10-15T02:28:14.407491Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1TEvPartitionReady. Aval parts: 0
2025-10-15T02:28:14.407504Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 read done: guid# 4fa881e7-8c3f6b9d-6b49de1a-e794e713, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-15T02:28:14.407512Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 response to read: guid# 4fa881e7-8c3f6b9d-6b49de1a-e794e713
2025-10-15T02:28:14.408254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.408254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:14.408302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-15T02:28:14.408334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-15T02:28:14.408446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.408484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.408932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.408951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.409014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-15T02:28:14.409059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-15T02:28:14.409101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-15T02:28:14.409148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-15T02:28:14.409700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.409274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-15T02:28:14.409284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-15T02:28:14.409301Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.409316Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 6 partNo 0 count 1 size 2253219
2025-10-15T02:28:14.409330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.409333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.409341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.409361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.409430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-15T02:28:14.411775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.411793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.411853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-15T02:28:14.411903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-15T02:28:14.411951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-15T02:28:14.412005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-15T02:28:14.412048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-15T02:28:14.412057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-15T02:28:14.412081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.412100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.421712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.421727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 1 size 717134 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.421760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.421775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T02:28:14.421785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-15T02:28:14.422372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.422384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.431232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 6 count 1 size 2253219 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.431275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.431285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.431294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.431302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.431316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-15T02:28:14.431320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.431325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-15T02:28:14.431327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.431330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-15T02:28:14.431332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.431336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-15T02:28:14.431343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.431349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-15T02:28:14.431405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.431424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.431427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:14.431452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T02:28:14.431473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-15T02:28:14.431477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-15T02:28:14.431480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-15T02:28:14.431483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-15T02:28:14.434407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 2253229 count 1 nextOffset 8 batches 5
2025-10-15T02:28:14.434459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T02:28:14.434473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-15T02:28:14.434477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-15T02:28:14.434481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-15T02:28:14.434485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-15T02:28:14.435021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 4506426 count 2 nextOffset 9 batches 9
2025-10-15T02:28:14.435043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.435146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,2 HeadOffset 7 endOffset 7 curOffset 9 d0000000000_00000000000000000007_00000_0000000002_00008? size 4506416 WTime 1760495294434
2025-10-15T02:28:14.436129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.436182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-15T02:28:14.436220Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.436232Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 2 size 4506416
2025-10-15T02:28:14.436237Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-15T02:28:14.436239Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000001_00004?(+) to d0000000000_00000000000000000001_00000_0000000001_00004?(+)
2025-10-15T02:28:14.436245Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000002_00000_0000000001_00004?(+) to d0000000000_00000000000000000002_00000_0000000001_00004?(+)
2025-10-15T02:28:14.436247Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000001_00004?(+) to d0000000000_00000000000000000003_00000_0000000001_00004?(+)
2025-10-15T02:28:14.436371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.444321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 0 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.444335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.444341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 2 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.444345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.444351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 2 size 4506416 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.444397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.444403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.444417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.444427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.444440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-15T02:28:14.444444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.444448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-15T02:28:14.444450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.444454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-15T02:28:14.444456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T02:28:14.444460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-15T02:28:14.444467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-15T02:28:14.444472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-15T02:28:14.444480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-15T02:28:14.444486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-15T02:28:14.444492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-15T02:28:14.444500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.444504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-15T02:28:14.444546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.444555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.444556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.444568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-15T02:28:14.444573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-15T02:28:14.444576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000002_00008?
2025-10-15T02:28:14.444579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11266051 bytes
2025-10-15T02:28:14.444599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-15T02:28:14.444624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-15T02:28:14.444629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T02:28:14.444631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000004_00000_0000000002_00008?
2025-10-15T02:28:14.444740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.444641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000006_00000_0000000001_00004?
2025-10-15T02:28:14.444654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000002_00008?
2025-10-15T02:28:14.444665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T02:28:14.444770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.444673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 4 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.444676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 6 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.444679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.444684Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-15T02:28:14.444695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63'
2025-10-15T02:28:14.444699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.444702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 2 parts 8 suffix '63'
2025-10-15T02:28:14.444711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:14.444716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.444863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-15T02:28:14.445019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-15T02:28:14.445152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-15T02:28:14.445287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-15T02:28:14.445486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-15T02:28:14.445961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 2253229 count 1 nextOffset 5 batches 5
2025-10-15T02:28:14.445978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-15T02:28:14.446114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-15T02:28:14.446264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-15T02:28:14.446404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-15T02:28:14.446487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-15T02:28:14.446951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 4506426 count 2 nextOffset 6 batches 9
2025-10-15T02:28:14.446968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.447082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-15T02:28:14.447213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-15T02:28:14.447346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-15T02:28:14.447481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-15T02:28:14.447538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-15T02:28:14.449171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 4 PartNo 0 PackedSize 6759623 count 3 nextOffset 7 batches 13
2025-10-15T02:28:14.449187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.449302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-15T02:28:14.449442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-15T02:28:14.456117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-15T02:28:14.456233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-15T02:28:14.456358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-15T02:28:14.456885Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Process answer. Aval parts: 1
2025-10-15T02:28:14.456939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-15T02:28:14.456956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1760495294456
2025-10-15T02:28:14.457218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-15T02:28:14.457230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-15T02:28:14.457383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-15T02:28:14.457527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-15T02:28:14.457591Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-15T02:28:14.457688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-15T02:28:14.457704Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-15T02:28:14.457733Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 2252976 to budget
2025-10-15T02:28:14.457761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-15T02:28:14.457756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.458067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.458466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-15T02:28:14.458579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,2 HeadOffset 3 endOffset 4 curOffset 9 d0000000000_00000000000000000007_00001_0000000002_00007| size 3994385 WTime 1760495294458
2025-10-15T02:28:14.459453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.459466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.459481Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.459496Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-15T02:28:14.459507Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 2 size 3994385
2025-10-15T02:28:14.459565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-15T02:28:14.459665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.462118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.462135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.462198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-15T02:28:14.462246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-15T02:28:14.462302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-15T02:28:14.462361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-15T02:28:14.462401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-15T02:28:14.462409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-15T02:28:14.462430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.462470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.462482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.462484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.462512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T02:28:14.462525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-15T02:28:14.462528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-15T02:28:14.462531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-15T02:28:14.462538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-15T02:28:14.463166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 2253229 count 1 nextOffset 10 batches 5
2025-10-15T02:28:14.463191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.463286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 9,1 HeadOffset 9 endOffset 9 curOffset 10 d0000000000_00000000000000000009_00000_0000000001_00004? size 2253219 WTime 1760495294462
2025-10-15T02:28:14.463659Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.463680Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 9 partNo 0 count 1 size 2253219
2025-10-15T02:28:14.473352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.473364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 2 size 3994385 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.473386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.473399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T02:28:14.473405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 2 parts 7 suffix '124' size 3994385
2025-10-15T02:28:14.473700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.473721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-15T02:28:14.474045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.474057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.475131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 9 count 1 size 2253219 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.475155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.475167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T02:28:14.475172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.475177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.475184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.475197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-15T02:28:14.475202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.475206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-15T02:28:14.475208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.475213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-15T02:28:14.475217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.475224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-15T02:28:14.475231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.475236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-15T02:28:14.475286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.475292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.475294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.475320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.475333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:14.475343Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:14.475399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-15T02:28:14.475415Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.475428Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000004_00000_0000000002_00008?(+) to d0000000000_00000000000000000004_00000_0000000002_00008?(+)
2025-10-15T02:28:14.475430Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000006_00000_0000000001_00004?(+) to d0000000000_00000000000000000006_00000_0000000001_00004?(+)
2025-10-15T02:28:14.475432Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000002_00008?(+) to d0000000000_00000000000000000007_00000_0000000002_00008?(+)
2025-10-15T02:28:14.475434Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000001_00001|(+) to d0000000000_00000000000000000003_00003_0000000001_00001|(+)
2025-10-15T02:28:14.475509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.475744Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (2-2)
2025-10-15T02:28:14.475777Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:14.475789Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-15T02:28:14.475889Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T02:28:14.475902Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
2025-10-15T02:28:14.476121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 4 count 2 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.476137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 6 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.476143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 7 count 2 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.476163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.476175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.476189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 4 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T02:28:14.476192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.476199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.476201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.476203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.476207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 6 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.476211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.476214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-15T02:28:14.476220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 1 parts 1 suffix '124' size 717134
2025-10-15T02:28:14.476097Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-15T02:28:14.476187Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got read request: guid# c86f7321-989509cb-1d5aa422-a9f982de
2025-10-15T02:28:14.476221Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 performing read request: guid# b5a8b58c-1a0aac44-c2d92a7e-f7b3d475, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T02:28:14.476257Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 4 ClientCommitOffset 0 committedOffset 0 Guid b5a8b58c-1a0aac44-c2d92a7e-f7b3d475
2025-10-15T02:28:14.476420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.476432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.476469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 524288 endOffset 10 max time lag 0ms effective offset 3
2025-10-15T02:28:14.476505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 2 blobs, size 7988778 count 4 last offset 3, current partition end offset: 10
2025-10-15T02:28:14.476858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-10-15T02:28:14.476880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.476886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.476899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 7. Have to read 1 of 2 from KV
2025-10-15T02:28:14.476926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-15T02:28:14.476937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T02:28:14.477148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.477492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.477605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.477616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.477652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-15T02:28:14.009000Z WriteTime: 2025-10-15T02:28:14.091000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:45414", "_ip": "ipv6:[::1]:45414" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:14.477729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.480226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.480239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.480384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-15T02:28:14.480446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-15T02:28:14.480520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-15T02:28:14.480585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-15T02:28:14.480626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-15T02:28:14.480634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-15T02:28:14.480733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.480759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.480773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.480779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.480810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T02:28:14.480825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-15T02:28:14.480828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-15T02:28:14.480831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-15T02:28:14.480836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-15T02:28:14.481237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2253230 count 1 nextOffset 11 batches 5
2025-10-15T02:28:14.481256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.481354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,1 HeadOffset 10 endOffset 10 curOffset 11 d0000000000_00000000000000000010_00000_0000000001_00004? size 2253220 WTime 1760495294480
2025-10-15T02:28:14.481624Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.481640Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.481960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 12 to 12
2025-10-15T02:28:14.482271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.482285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-15T02:28:14.482336Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.485153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 255 queued_in_partition_duration_ms: 7 }
2025-10-15T02:28:14.485172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 5
2025-10-15T02:28:14.485643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 13 to 13
2025-10-15T02:28:14.486050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.486067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-15T02:28:14.487437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 250 queued_in_partition_duration_ms: 9 }
2025-10-15T02:28:14.487454Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.487456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 6
2025-10-15T02:28:14.488158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.488511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.488663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.488681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.488725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-15T02:28:14.488830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.489053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 28 queued_in_partition_duration_ms: 3 }
2025-10-15T02:28:14.489065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 7
2025-10-15T02:28:14.489109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 25 }
2025-10-15T02:28:14.489112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 8
2025-10-15T02:28:14.489133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 9 queued_in_partition_duration_ms: 22 }
2025-10-15T02:28:14.489136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 9
2025-10-15T02:28:14.489156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 12 }
2025-10-15T02:28:14.489159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 10
2025-10-15T02:28:14.491193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 14 to 14
2025-10-15T02:28:14.491479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.491496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-15T02:28:14.491694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.491710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.491819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-15T02:28:14.491883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-15T02:28:14.491945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-15T02:28:14.492017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-15T02:28:14.492070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-15T02:28:14.492075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-15T02:28:14.492099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.492125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.493315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.493965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.494533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.494569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.494781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
2025-10-15T02:28:14.495049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T02:28:14.495135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.498486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.498508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.498593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-15T02:28:14.498741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-15T02:28:14.498809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-15T02:28:14.498873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-15T02:28:14.498934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-15T02:28:14.498946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-15T02:28:14.499031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.499060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.499078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.499102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.499123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.499130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.499137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.499140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-15T02:28:14.499143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.499147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-15T02:28:14.499149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.499154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-15T02:28:14.499155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.499160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-15T02:28:14.499167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.499172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-15T02:28:14.499209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.499225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.499228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:14.499248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T02:28:14.499265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-15T02:28:14.499269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-15T02:28:14.499272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-15T02:28:14.499276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-15T02:28:14.499754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 2253230 count 1 nextOffset 12 batches 5
2025-10-15T02:28:14.499771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T02:28:14.499779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-15T02:28:14.499782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-15T02:28:14.499788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-15T02:28:14.499792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-15T02:28:14.508164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 11 PartNo 0 PackedSize 4506428 count 2 nextOffset 13 batches 9
2025-10-15T02:28:14.508198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.508310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 11,2 HeadOffset 11 endOffset 11 curOffset 13 d0000000000_00000000000000000011_00000_0000000002_00008? size 4506418 WTime 1760495294508
2025-10-15T02:28:14.517995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.518074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-15T02:28:14.518106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.518111Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.518127Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 11 partNo 0 count 2 size 4506418
2025-10-15T02:28:14.518274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.524921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 11 count 2 size 4506418 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.524949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.524969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.524971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:14.524985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.524998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-15T02:28:14.525006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-15T02:28:14.525013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-15T02:28:14.525025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-15T02:28:14.525037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-15T02:28:14.525042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-15T02:28:14.525048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-15T02:28:14.525053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-15T02:28:14.525059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-15T02:28:14.525065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.525069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-15T02:28:14.525130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.525136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.525138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.525151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000009_00000_0000000001_00004?
2025-10-15T02:28:14.525157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000001_00004?
2025-10-15T02:28:14.525160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000011_00000_0000000002_00008?
2025-10-15T02:28:14.525163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 9012857 bytes
2025-10-15T02:28:14.525185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-15T02:28:14.525210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-15T02:28:14.525215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T02:28:14.525218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000009_00000_0000000001_00004?
2025-10-15T02:28:14.525227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000001_00004?
2025-10-15T02:28:14.525241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000011_00000_0000000002_00008?
2025-10-15T02:28:14.525253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T02:28:14.525264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 9 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.525270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.525273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 11 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.525282Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-15T02:28:14.525291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.525300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.525302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63'
2025-10-15T02:28:14.525309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:14.525317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.525331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.525364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.525442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-15T02:28:14.525597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-15T02:28:14.525731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-15T02:28:14.525882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-15T02:28:14.526067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-15T02:28:14.526455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 9 PartNo 0 PackedSize 2253229 count 1 nextOffset 10 batches 5
2025-10-15T02:28:14.526476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.526615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-15T02:28:14.528651Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.528728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 17 }
2025-10-15T02:28:14.528741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 11
2025-10-15T02:28:14.526753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-15T02:28:14.526901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-15T02:28:14.527037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-15T02:28:14.527112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-15T02:28:14.528538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295601
2025-10-15T02:28:14.528548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295601 WTime 1760495294528
2025-10-15T02:28:14.528624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-15T02:28:14.528635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.528811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 6 }
2025-10-15T02:28:14.528819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 12
2025-10-15T02:28:14.528794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-15T02:28:14.528837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 26 }
2025-10-15T02:28:14.528840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 13
2025-10-15T02:28:14.528955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-15T02:28:14.529123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-15T02:28:14.529228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.529338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-15T02:28:14.529550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-15T02:28:14.529614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.530069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-15T02:28:14.530089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-15T02:28:14.530243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-15T02:28:14.530406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-15T02:28:14.530573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-15T02:28:14.530642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-15T02:28:14.531510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-15T02:28:14.531605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,3 HeadOffset 7 endOffset 9 curOffset 13 d0000000000_00000000000000000010_00004_0000000003_00008| size 4711504 WTime 1760495294531
2025-10-15T02:28:14.532274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 15 to 15
2025-10-15T02:28:14.532213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.532232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.532253Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.532264Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295601
2025-10-15T02:28:14.532271Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 3 size 4711504
2025-10-15T02:28:14.532334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-15T02:28:14.532473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.532622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.532636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-15T02:28:14.534911Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.535084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.535108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.535204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-15T02:28:14.535271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-15T02:28:14.535331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-15T02:28:14.535389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-15T02:28:14.535424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-15T02:28:14.535432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-15T02:28:14.535456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.535435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.535485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.535497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.535505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.535537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T02:28:14.535558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-15T02:28:14.535562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-15T02:28:14.535565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-15T02:28:14.535568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-15T02:28:14.536161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.536464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-15T02:28:14.536485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.536591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 13,1 HeadOffset 13 endOffset 13 curOffset 14 d0000000000_00000000000000000013_00000_0000000001_00004? size 2253220 WTime 1760495294533
2025-10-15T02:28:14.536901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.536916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.536929Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.536942Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.537017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-15T02:28:14.537136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.538516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 16 to 16
2025-10-15T02:28:14.538843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.538857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-15T02:28:14.540265Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.540838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.539979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.539993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.540087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-15T02:28:14.540149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-15T02:28:14.540596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-15T02:28:14.540663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-15T02:28:14.540702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-15T02:28:14.540709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-15T02:28:14.540733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.540755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.541383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.541538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.541661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.541554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.541580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-15T02:28:14.543851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 17 to 17
2025-10-15T02:28:14.544047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.544066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.544199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.544211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-15T02:28:14.544182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-15T02:28:14.544250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-15T02:28:14.544338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-15T02:28:14.544413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-15T02:28:14.544456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-15T02:28:14.544461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-15T02:28:14.544481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.544503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.546873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.546883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 3 size 4711504 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.546900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.547629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.547636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.547797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T02:28:14.547806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 2 parts 7 suffix '124' size 3994385
2025-10-15T02:28:14.547810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-10-15T02:28:14.547832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 3994385 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:14.547839Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:14.549194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.549213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.549231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.549245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.549256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.549267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-15T02:28:14.549271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.549275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-15T02:28:14.549276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.549280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-15T02:28:14.549282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.549286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-15T02:28:14.549293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.549297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-15T02:28:14.549338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.549356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.549358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:14.549382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T02:28:14.549399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-15T02:28:14.549405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-15T02:28:14.549408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-15T02:28:14.549412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-15T02:28:14.550202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 2253230 count 1 nextOffset 15 batches 5
2025-10-15T02:28:14.550226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T02:28:14.550232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-15T02:28:14.550235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-15T02:28:14.550238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-15T02:28:14.550242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-15T02:28:14.550751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 4506428 count 2 nextOffset 16 batches 9
2025-10-15T02:28:14.550765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.550871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,2 HeadOffset 14 endOffset 14 curOffset 16 d0000000000_00000000000000000014_00000_0000000002_00008? size 4506418 WTime 1760495294550
2025-10-15T02:28:14.551416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.551452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-15T02:28:14.551476Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.551490Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 2 size 4506418
2025-10-15T02:28:14.551499Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000009_00000_0000000001_00004?(+) to d0000000000_00000000000000000009_00000_0000000001_00004?(+)
2025-10-15T02:28:14.551500Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000001_00004?(+) to d0000000000_00000000000000000010_00000_0000000001_00004?(+)
2025-10-15T02:28:14.551504Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000011_00000_0000000002_00008?(+) to d0000000000_00000000000000000011_00000_0000000002_00008?(+)
2025-10-15T02:28:14.551506Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000002_00007|(+) to d0000000000_00000000000000000007_00001_0000000002_00007|(+)
2025-10-15T02:28:14.551597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.556923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 9 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.556933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 10 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.556936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 11 count 2 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.556943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 2 size 4506418 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.556969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.556985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.556989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 9 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-15T02:28:14.556995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-15T02:28:14.557008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.557012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-15T02:28:14.557013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 11 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:14.557017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-15T02:28:14.557019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-15T02:28:14.557025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:14.557028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-15T02:28:14.557034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-15T02:28:14.557039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-15T02:28:14.557044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-15T02:28:14.557048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-15T02:28:14.557052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.557065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-15T02:28:14.557098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.557104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.557106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.557116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.557141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-15T02:28:14.557159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-15T02:28:14.557361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.557397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.559977Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.561894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.562254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.562715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.563778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 18 to 18
2025-10-15T02:28:14.564113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.564128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-15T02:28:14.564175Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.562508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.562526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.562569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-15T02:28:14.565322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.565332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.565410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-15T02:28:14.565725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-10-15T02:28:14.565737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561269708810229994:2487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T02:28:14.565465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-15T02:28:14.565524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-15T02:28:14.565616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-15T02:28:14.565662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-15T02:28:14.565667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-15T02:28:14.565688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.565712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.565722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.565727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.565759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T02:28:14.565772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-15T02:28:14.565776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-15T02:28:14.565779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-15T02:28:14.565783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-15T02:28:14.566301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 16 PartNo 0 PackedSize 2253230 count 1 nextOffset 17 batches 5
2025-10-15T02:28:14.566325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.566436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 16,1 HeadOffset 16 endOffset 16 curOffset 17 d0000000000_00000000000000000016_00000_0000000001_00004? size 2253220 WTime 1760495294566
2025-10-15T02:28:14.566812Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.566824Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 16 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.572634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 15 }
2025-10-15T02:28:14.572652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 14
2025-10-15T02:28:14.572755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 9 }
2025-10-15T02:28:14.572759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 15
2025-10-15T02:28:14.572797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 5 }
2025-10-15T02:28:14.572800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 16
2025-10-15T02:28:14.572949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 16 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.572977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.572994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.573000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.573007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.573029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-15T02:28:14.573034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.573039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-15T02:28:14.573041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.573045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-15T02:28:14.573049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.573057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-15T02:28:14.573063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.573067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-15T02:28:14.573105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.573108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.573110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.573134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00000_0000000001_00004?
2025-10-15T02:28:14.573136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000002_00008?
2025-10-15T02:28:14.573138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000016_00000_0000000001_00004?
2025-10-15T02:28:14.573141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 9012858 bytes
2025-10-15T02:28:14.573164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-15T02:28:14.573179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T02:28:14.573181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00000_0000000001_00004?
2025-10-15T02:28:14.573189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000002_00008?
2025-10-15T02:28:14.573197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000016_00000_0000000001_00004?
2025-10-15T02:28:14.573210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T02:28:14.573219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.573232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.573235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 16 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.573245Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-15T02:28:14.573267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:14.573272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.573403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-15T02:28:14.573581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-15T02:28:14.573718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-15T02:28:14.573886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-15T02:28:14.573967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-15T02:28:14.574412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 13 PartNo 0 PackedSize 2253230 count 1 nextOffset 14 batches 5
2025-10-15T02:28:14.574446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.574607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-15T02:28:14.574709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 19 to 19
2025-10-15T02:28:14.574775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-15T02:28:14.574958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-15T02:28:14.574979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.575117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.575132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-15T02:28:14.575399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.576936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.576948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 2 parts 8 suffix '63'
2025-10-15T02:28:14.576965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.576987Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.577536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988760
2025-10-15T02:28:14.577686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-15T02:28:14.577944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-15T02:28:14.577970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988760 WTime 1760495294577
2025-10-15T02:28:14.578201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-15T02:28:14.578217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-15T02:28:14.578374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-15T02:28:14.578535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-15T02:28:14.578719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-15T02:28:14.578814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-15T02:28:14.579341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-15T02:28:14.579363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.579493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-15T02:28:14.579590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.579918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 8 }
2025-10-15T02:28:14.579930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 17
2025-10-15T02:28:14.580472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 20 to 20
2025-10-15T02:28:14.580956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.580968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-15T02:28:14.581702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.583408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.583781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.579636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-15T02:28:14.579780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-15T02:28:14.579919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-15T02:28:14.579971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-15T02:28:14.580570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-15T02:28:14.580651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,3 HeadOffset 10 endOffset 13 curOffset 17 d0000000000_00000000000000000014_00002_0000000003_00010| size 5735558 WTime 1760495294580
2025-10-15T02:28:14.581462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.581473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.581491Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.581502Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988760
2025-10-15T02:28:14.581511Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 3 size 5735558
2025-10-15T02:28:14.581577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-15T02:28:14.584256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.584265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.584355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-15T02:28:14.584436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-15T02:28:14.584497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-15T02:28:14.584567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-15T02:28:14.584600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-15T02:28:14.584605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-15T02:28:14.584632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.584635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.584649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.584673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.584684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.584687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.584719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T02:28:14.584732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-15T02:28:14.584735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-15T02:28:14.584738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-15T02:28:14.584742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-15T02:28:14.585182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-15T02:28:14.585196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.585308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,1 HeadOffset 17 endOffset 17 curOffset 18 d0000000000_00000000000000000017_00000_0000000001_00004? size 2253220 WTime 1760495294585
2025-10-15T02:28:14.585937Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.585958Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.586139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.585980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-15T02:28:14.589572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.589589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.589666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-15T02:28:14.589723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-15T02:28:14.589791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-15T02:28:14.589879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-15T02:28:14.589910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-15T02:28:14.589919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-15T02:28:14.589940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-15T02:28:14.589960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T02:28:14.589977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.590023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.590023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T02:28:14.590030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T02:28:14.590043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.590056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-15T02:28:14.591798Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.592484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.592854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.594575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-15T02:28:14.594786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:14.594862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:14.594912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:14.594926Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:14.594955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.594973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.595014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-15T02:28:14.595172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 21 to 21
2025-10-15T02:28:14.595548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.595560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-15T02:28:14.595874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-15T02:28:14.596830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.598468Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 17 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294137 CreateTimestampMS: 1760495294089 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 1 BlobsFromCache: 1 SizeLag: 6759749 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 17 StartOffset: 0 } Cookie: 3 }
2025-10-15T02:28:14.598762Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 17
2025-10-15T02:28:14.598784Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 17 ReadOffset 4 ReadGuid b5a8b58c-1a0aac44-c2d92a7e-f7b3d475 has messages 1
2025-10-15T02:28:14.598816Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 17, WTime# 1760495294137, sizeLag# 6759749
2025-10-15T02:28:14.598819Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1TEvPartitionReady. Aval parts: 0
2025-10-15T02:28:14.598831Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 read done: guid# b5a8b58c-1a0aac44-c2d92a7e-f7b3d475, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-15T02:28:14.598839Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 response to read: guid# b5a8b58c-1a0aac44-c2d92a7e-f7b3d475
2025-10-15T02:28:14.599518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.599538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.599810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-15T02:28:14.599870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-15T02:28:14.599931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-15T02:28:14.599989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-15T02:28:14.600024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-15T02:28:14.600030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-15T02:28:14.600054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.600078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.614809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988760 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.614824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 5735558 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.614865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.614867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T02:28:14.614874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T02:28:14.614880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 3 parts 8 suffix '124' size 4711504
2025-10-15T02:28:14.614897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-10-15T02:28:14.615844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.615860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:180: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.616039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:14.616050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 4711504 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:14.616055Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:14.616787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.616806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.616821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.616825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.616831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.616843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-15T02:28:14.616849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.616855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-15T02:28:14.616857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.616862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-15T02:28:14.616863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.616868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-15T02:28:14.616874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.616882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-15T02:28:14.616914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.616933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.616936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:14.616961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T02:28:14.616979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-15T02:28:14.616987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-15T02:28:14.616990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-15T02:28:14.616994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-15T02:28:14.617516Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T02:28:14.617506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.617545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T02:28:14.617555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-15T02:28:14.617558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-15T02:28:14.617564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-15T02:28:14.617567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-15T02:28:14.618171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-15T02:28:14.618193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.618309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,2 HeadOffset 18 endOffset 18 curOffset 20 d0000000000_00000000000000000018_00000_0000000002_00008? size 4506418 WTime 1760495294618
2025-10-15T02:28:14.618927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.618972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-15T02:28:14.618998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.619006Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.619019Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 2 size 4506418
2025-10-15T02:28:14.619024Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00000_0000000001_00004?(+) to d0000000000_00000000000000000013_00000_0000000001_00004?(+)
2025-10-15T02:28:14.619027Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000002_00008?(+) to d0000000000_00000000000000000014_00000_0000000002_00008?(+)
2025-10-15T02:28:14.619029Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000016_00000_0000000001_00004?(+) to d0000000000_00000000000000000016_00000_0000000001_00004?(+)
2025-10-15T02:28:14.619031Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000003_00008|(+) to d0000000000_00000000000000000010_00004_0000000003_00008|(+)
2025-10-15T02:28:14.619114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.621230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 22 to 22
2025-10-15T02:28:14.621526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.621539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-15T02:28:14.624674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 13 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.624686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 14 count 2 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.624691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 16 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.624700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 2 size 4506418 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.624719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.624737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.624743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 13 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.624746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-15T02:28:14.624758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:14.624763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 16 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.624768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-15T02:28:14.624770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:14.624775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-15T02:28:14.624777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-15T02:28:14.624787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-15T02:28:14.624794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-15T02:28:14.624799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-15T02:28:14.624804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-15T02:28:14.624810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-15T02:28:14.624816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.624820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-15T02:28:14.625095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.625103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.625106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.625119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:14.625143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-15T02:28:14.625168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-15T02:28:14.625452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.625486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.641951Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.646923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 23 to 23
2025-10-15T02:28:14.647211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.647223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-15T02:28:14.673141Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Process answer. Aval parts: 1
2025-10-15T02:28:14.675060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.675459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.675674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.675695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.675746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-15T02:28:14.675817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.678067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.678415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.678436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.678440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.678529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-15T02:28:14.678683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-15T02:28:14.678763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-15T02:28:14.678824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-15T02:28:14.678864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-15T02:28:14.678873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-15T02:28:14.678904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.678915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.678928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.678961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.678977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.678980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.679014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T02:28:14.679033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-15T02:28:14.679040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-15T02:28:14.679045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-15T02:28:14.679049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-15T02:28:14.679457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-15T02:28:14.679481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.679596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 20,1 HeadOffset 20 endOffset 20 curOffset 21 d0000000000_00000000000000000020_00000_0000000001_00004? size 2253220 WTime 1760495294679
2025-10-15T02:28:14.680230Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.680251Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.680268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-15T02:28:14.682621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.684900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.684918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.684995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-15T02:28:14.685049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-15T02:28:14.685107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-15T02:28:14.685170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-15T02:28:14.687608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-15T02:28:14.687623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-15T02:28:14.687725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.687753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.687768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.687780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.687797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.687803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.687808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.687817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-15T02:28:14.687821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.687825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-15T02:28:14.687827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.687833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-15T02:28:14.687839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.687844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-15T02:28:14.687849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.687853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-15T02:28:14.687888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.687900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.687902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.687925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T02:28:14.687943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-15T02:28:14.687947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-15T02:28:14.687955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-15T02:28:14.687958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-15T02:28:14.688371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 0 PackedSize 2253230 count 1 nextOffset 22 batches 5
2025-10-15T02:28:14.688390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.688496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,1 HeadOffset 21 endOffset 21 curOffset 22 d0000000000_00000000000000000021_00000_0000000001_00004? size 2253220 WTime 1760495294688
2025-10-15T02:28:14.688905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000001_00004?
2025-10-15T02:28:14.688912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000018_00000_0000000002_00008?
2025-10-15T02:28:14.688914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000001_00004?
2025-10-15T02:28:14.688917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 9012858 bytes
2025-10-15T02:28:14.688948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-15T02:28:14.688972Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.688983Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.688992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-15T02:28:14.688995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000001_00004?
2025-10-15T02:28:14.689004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000018_00000_0000000002_00008?
2025-10-15T02:28:14.689014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000001_00004?
2025-10-15T02:28:14.689027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-15T02:28:14.689079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.689082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 18 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.689084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T02:28:14.000000Z
2025-10-15T02:28:14.689094Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-15T02:28:14.689134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:14.689140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.689152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.689158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '63'
2025-10-15T02:28:14.689161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:14.689278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-15T02:28:14.689425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-15T02:28:14.689147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.689573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-15T02:28:14.689723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-15T02:28:14.689813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-15T02:28:14.690403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-15T02:28:14.690421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.690568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-15T02:28:14.691933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988778
2025-10-15T02:28:14.692114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-15T02:28:14.692259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-15T02:28:14.692404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-15T02:28:14.692636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-15T02:28:14.692655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988778 WTime 1760495294692
2025-10-15T02:28:14.693039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-15T02:28:14.693055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-15T02:28:14.693179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-15T02:28:14.693315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-15T02:28:14.693469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-15T02:28:14.693546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-15T02:28:14.694085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-15T02:28:14.694101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:14.694255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-15T02:28:14.694420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-15T02:28:14.694588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-15T02:28:14.694746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-15T02:28:14.694810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-15T02:28:14.697251Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.698015Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-15T02:28:14.698217Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-15T02:28:14.698236Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 2252976 to budget
2025-10-15T02:28:14.699274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 6759626 count 3 nextOffset 21 batches 13
2025-10-15T02:28:14.699373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,3 HeadOffset 14 endOffset 17 curOffset 21 d0000000000_00000000000000000018_00000_0000000003_00012| size 6759616 WTime 1760495294699
2025-10-15T02:28:14.700530Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.700548Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988778
2025-10-15T02:28:14.700556Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 6759616
2025-10-15T02:28:14.700727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 24 to 24
2025-10-15T02:28:14.701003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.701014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-15T02:28:14.701397Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-15T02:28:14.701415Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:14.701425Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-15T02:28:14.701525Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T02:28:14.701950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.701976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:14.701995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:14.702002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.702013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-15T02:28:14.702016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:14.702019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.702023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-15T02:28:14.702025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.702029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-15T02:28:14.702031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.702035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-15T02:28:14.702042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:14.702053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-15T02:28:14.702089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.702091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.702093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.702102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:14.702120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-15T02:28:14.702234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.703202Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
2025-10-15T02:28:14.703210Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-15T02:28:14.703267Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got read request: guid# 212aa240-a133fe05-abe55922-df348ecf
2025-10-15T02:28:14.703294Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 performing read request: guid# cccccbf6-76bd5f68-78e9b7b7-54803468, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 15, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T02:28:14.703320Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 15 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 17 ClientCommitOffset 0 committedOffset 0 Guid cccccbf6-76bd5f68-78e9b7b7-54803468
2025-10-15T02:28:14.703765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.705859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.705876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.705936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 15 size 524288 endOffset 22 max time lag 0ms effective offset 4
2025-10-15T02:28:14.705990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 2 blobs, size 8295601 count 6 last offset 7, current partition end offset: 22
2025-10-15T02:28:14.705996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-15T02:28:14.706008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 3 partno 3 count 4 parts_count 14 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.706010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:14.706028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 8. Have to read 2 of 2 from KV
2025-10-15T02:28:14.706045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 3 partno 3 count 4 parts_count 14
2025-10-15T02:28:14.706055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-10-15T02:28:14.706237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.706478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.706499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.706536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-15T02:28:14.706705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-15T02:28:14.089000Z WriteTime: 2025-10-15T02:28:14.137000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:45414", "server": "ipv6:[::1]:45414" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:14.709266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.709283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.709356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-15T02:28:14.709420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-15T02:28:14.709476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-15T02:28:14.709604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-15T02:28:14.709665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-15T02:28:14.709675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-15T02:28:14.709694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.709720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:14.709735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:14.709739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:14.709771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T02:28:14.709791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-15T02:28:14.709798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-15T02:28:14.709801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-15T02:28:14.709804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-15T02:28:14.710268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 22 PartNo 0 PackedSize 2253230 count 1 nextOffset 23 batches 5
2025-10-15T02:28:14.710295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:14.710411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 22,1 HeadOffset 22 endOffset 22 curOffset 23 d0000000000_00000000000000000022_00000_0000000001_00004? size 2253220 WTime 1760495294710
2025-10-15T02:28:14.710535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 25 to 25
2025-10-15T02:28:14.710710Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:14.710732Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 22 partNo 0 count 1 size 2253220
2025-10-15T02:28:14.712356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.712372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-15T02:28:14.719268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.729868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.730259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.730488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.730520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.730580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-15T02:28:14.730707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.732974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.732995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.733070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-15T02:28:14.733132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-15T02:28:14.733244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-15T02:28:14.733307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-15T02:28:14.733344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-15T02:28:14.733354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-15T02:28:14.733379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.733408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.807234Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.807990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.808371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.808613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.808657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.808689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-15T02:28:14.808804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.810677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 26 to 26
2025-10-15T02:28:14.811476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.811495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.814268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-15T02:28:14.814362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-15T02:28:14.814439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-15T02:28:14.814519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-15T02:28:14.814582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-15T02:28:14.814593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-15T02:28:14.814627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.814657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.819742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.920052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.925670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.925693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-15T02:28:14.925758Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.929402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 27 to 27
2025-10-15T02:28:14.931536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.931551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-15T02:28:14.931935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.932661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:14.932705Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:14.936184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.936364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.936385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.936432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-15T02:28:14.939279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.939300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.939381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-15T02:28:14.939444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-15T02:28:14.939510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-15T02:28:14.936550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.938613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:14.943855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 31 }
2025-10-15T02:28:14.943893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 18
2025-10-15T02:28:14.943900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:14.951232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-15T02:28:14.951309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-15T02:28:14.951315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-15T02:28:14.951408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.951438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.975187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 28 to 28
2025-10-15T02:28:14.975482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:14.975496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-15T02:28:14.976803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:14.977029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.977053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.977096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-15T02:28:14.977211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:14.981024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:14.981051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:14.981505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-15T02:28:14.981958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-15T02:28:14.982372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-15T02:28:14.982818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-15T02:28:14.982877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-15T02:28:14.982888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-15T02:28:14.982929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:14.982961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:14.996765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:14.996816Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.001973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 27 }
2025-10-15T02:28:15.001992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 19
2025-10-15T02:28:15.001999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.010214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 7 queued_in_partition_duration_ms: 17 }
2025-10-15T02:28:15.010233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 20
2025-10-15T02:28:15.010528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 29 to 29
2025-10-15T02:28:15.010848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.010860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-15T02:28:15.018317Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.019630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 8 }
2025-10-15T02:28:15.019645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 21
2025-10-15T02:28:15.019762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 14 }
2025-10-15T02:28:15.019768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 22
2025-10-15T02:28:15.022923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.023310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.028094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.028142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.028155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.028182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-15T02:28:15.028191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T02:28:15.028194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T02:28:15.028204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.028207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295601 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.028423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-15T02:28:15.028877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:15.029059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.029241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.029762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.029880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T02:28:15.029890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T02:28:15.029896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988760
2025-10-15T02:28:15.029900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T02:28:15.030859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T02:28:15.031225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.031378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.031768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.032442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T02:28:15.032941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.033310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.033824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.034229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:15.034744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:15.035284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.038615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.039119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.039794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T02:28:15.040162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.040653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.041138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.041354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:15.041906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:15.042400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.042903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.043397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:15.043477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-15T02:28:15.045120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-15T02:28:15.045228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-15T02:28:15.045344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.045372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 8
2025-10-15T02:28:15.045382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988760 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:15.045388Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.045517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-15T02:28:15.045552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988778 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.045556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 6759616 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.045573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 22 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.045610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 3 parts 10 suffix '124' size 5735558
2025-10-15T02:28:15.045625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.045630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T02:28:15.045637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:15.045642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.045645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T02:28:15.045666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.045675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.047296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.047683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.053103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.054224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.054243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:15.054262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.054285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.054305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.054320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-15T02:28:15.054325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.054330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-15T02:28:15.054331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.054335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-15T02:28:15.054336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.054340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-15T02:28:15.054347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.054351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-15T02:28:15.054652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.054682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.054685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-15T02:28:15.054714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T02:28:15.054728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-15T02:28:15.054734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-15T02:28:15.054738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-15T02:28:15.054741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-15T02:28:15.055789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 2253230 count 1 nextOffset 24 batches 5
2025-10-15T02:28:15.055819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T02:28:15.055827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-15T02:28:15.055830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-15T02:28:15.055836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-15T02:28:15.055846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-15T02:28:15.056403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 4506428 count 2 nextOffset 25 batches 9
2025-10-15T02:28:15.056422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T02:28:15.056432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-15T02:28:15.056436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-15T02:28:15.056440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-15T02:28:15.056443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-15T02:28:15.056968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 30 to 30
2025-10-15T02:28:15.057337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 0 PackedSize 6759626 count 3 nextOffset 26 batches 13
2025-10-15T02:28:15.057364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T02:28:15.057372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-15T02:28:15.057376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-15T02:28:15.057379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-15T02:28:15.057445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.057460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-15T02:28:15.059156Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.065202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 31 to 31
2025-10-15T02:28:15.065526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.065544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-15T02:28:15.066306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 27 partNo 3 result is x0000000000_00000000000000000023_00000_0000000003_00015? size 8295638
2025-10-15T02:28:15.066339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-15T02:28:15.066359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000023_00000_0000000003_00015? new key d0000000000_00000000000000000023_00000_0000000003_00015? size 8295638 WTime 1760495295065
2025-10-15T02:28:15.066500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 1 NewHead: Offset 26 PartNo 3 PackedSize 717145 count 1 nextOffset 27 batches 2
2025-10-15T02:28:15.066521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.066750Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.066667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 26,1 HeadOffset 23 endOffset 23 curOffset 27 d0000000000_00000000000000000026_00003_0000000001_00001? size 717135 WTime 1760495295065
2025-10-15T02:28:15.066801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:15.066849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 4506418 cause it's been evicted from L2. Actual L1 size: 9
2025-10-15T02:28:15.066858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 20 size 2253220 cause it's been evicted from L2. Actual L1 size: 8
2025-10-15T02:28:15.066862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 17 size 2253220 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:15.066866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 5735558 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:15.066870Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.066893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 2253220 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T02:28:15.066898Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.067750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.067768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.067852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-15T02:28:15.067916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-15T02:28:15.067991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-15T02:28:15.068062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-15T02:28:15.068102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-15T02:28:15.068110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-15T02:28:15.068143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.068150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.068186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-15T02:28:15.068214Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.068236Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 0 count 3 size 8295638
2025-10-15T02:28:15.068245Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 26 partNo 3 count 1 size 717135
2025-10-15T02:28:15.068253Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000001_00004?(+) to d0000000000_00000000000000000017_00000_0000000001_00004?(+)
2025-10-15T02:28:15.068256Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000002_00008?(+) to d0000000000_00000000000000000018_00000_0000000002_00008?(+)
2025-10-15T02:28:15.068258Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000001_00004?(+) to d0000000000_00000000000000000020_00000_0000000001_00004?(+)
2025-10-15T02:28:15.068260Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00002_0000000003_00010|(+) to d0000000000_00000000000000000014_00002_0000000003_00010|(+)
2025-10-15T02:28:15.068268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.068289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.068364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-15T02:28:15.068708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 344 }
2025-10-15T02:28:15.068728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 23
2025-10-15T02:28:15.065681Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 22 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294146 CreateTimestampMS: 1760495294109 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294150 CreateTimestampMS: 1760495294123 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294401 CreateTimestampMS: 1760495294144 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294431 CreateTimestampMS: 1760495294151 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294434 CreateTimestampMS: 1760495294218 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1760495294462 CreateTimestampMS: 1760495294225 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 18446744073705251016 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 22 StartOffset: 0 } Cookie: 4 }
2025-10-15T02:28:15.068366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.068687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.069822Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 22
2025-10-15T02:28:15.069975Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 22 ReadOffset 10 ReadGuid cccccbf6-76bd5f68-78e9b7b7-54803468 has messages 1
2025-10-15T02:28:15.069987Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 22, WTime# 1760495294462, sizeLag# 18446744073705251016
2025-10-15T02:28:15.069991Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1TEvPartitionReady. Aval parts: 0
2025-10-15T02:28:15.070023Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 read done: guid# cccccbf6-76bd5f68-78e9b7b7-54803468, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 13517780
2025-10-15T02:28:15.070034Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 response to read: guid# cccccbf6-76bd5f68-78e9b7b7-54803468
2025-10-15T02:28:15.070470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 32 to 32
2025-10-15T02:28:15.070910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.070923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-15T02:28:15.070379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.070744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.071242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.071260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.071336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-15T02:28:15.071393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-15T02:28:15.071647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-15T02:28:15.071898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-15T02:28:15.071944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-15T02:28:15.071949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-15T02:28:15.071978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.071981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.072005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.072029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.072046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-15T02:28:15.074257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.075867Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.076985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.077006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.077281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-15T02:28:15.077530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-15T02:28:15.077585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-15T02:28:15.077641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-15T02:28:15.077806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-15T02:28:15.077819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-15T02:28:15.077880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.077920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.079309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 3 size 8295638 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.079318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 26 count 1 size 717135 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.079335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.079350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-15T02:28:15.079354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.079357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295601
2025-10-15T02:28:15.079361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T02:28:15.079367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 26 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T02:28:15.079374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-15T02:28:15.079379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-15T02:28:15.079385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-15T02:28:15.079391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-15T02:28:15.079414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-15T02:28:15.079420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-15T02:28:15.079426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-15T02:28:15.079432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-15T02:28:15.079446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-15T02:28:15.079454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-15T02:28:15.079461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-15T02:28:15.079468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-15T02:28:15.079473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-15T02:28:15.079478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-15T02:28:15.079484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-15T02:28:15.079489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-15T02:28:15.079494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-15T02:28:15.079500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-15T02:28:15.079505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-15T02:28:15.079511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.079515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-15T02:28:15.079709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 33 to 33
2025-10-15T02:28:15.080138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.080161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-15T02:28:15.083195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.083228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.083234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.079553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.079573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.079575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-15T02:28:15.079606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T02:28:15.079620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-15T02:28:15.079624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-15T02:28:15.079628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-15T02:28:15.079631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-15T02:28:15.080188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-15T02:28:15.080228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T02:28:15.080236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-15T02:28:15.080239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-15T02:28:15.080242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-15T02:28:15.080245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-15T02:28:15.080831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-10-15T02:28:15.080846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T02:28:15.080852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-15T02:28:15.080856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-15T02:28:15.080860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-15T02:28:15.080866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-15T02:28:15.081460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 6759626 count 3 nextOffset 30 batches 13
2025-10-15T02:28:15.081473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.081592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 27,3 HeadOffset 27 endOffset 27 curOffset 30 d0000000000_00000000000000000027_00000_0000000003_00012? size 6759616 WTime 1760495295081
2025-10-15T02:28:15.082493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000021_00000_0000000001_00004?
2025-10-15T02:28:15.082497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-15T02:28:15.082499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00000_0000000003_00015?
2025-10-15T02:28:15.082501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000026_00003_0000000001_00001?
2025-10-15T02:28:15.082504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 13519213 bytes
2025-10-15T02:28:15.082550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295601 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:15.082553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T02:28:15.082573Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.082595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-15T02:28:15.082631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-15T02:28:15.082646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-15T02:28:15.082658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-15T02:28:15.082773Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.082787Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 3 size 6759616
2025-10-15T02:28:15.082795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-15T02:28:15.082798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000021_00000_0000000001_00004?
2025-10-15T02:28:15.082808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000022_00000_0000000001_00004?
2025-10-15T02:28:15.082818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00000_0000000003_00015?
2025-10-15T02:28:15.082831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000026_00003_0000000001_00001?
2025-10-15T02:28:15.082841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-15T02:28:15.082889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 21 partno 0 count 1 parts_count 4 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.082895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 22 partno 0 count 1 parts_count 4 source 1 size 2253220 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.082898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.082902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 26 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.082910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 4 from KV
2025-10-15T02:28:15.082949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63'
2025-10-15T02:28:15.082953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 3 parts 15 suffix '63'
2025-10-15T02:28:15.082955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 26 partno 3 count 1 parts 1 suffix '63'
2025-10-15T02:28:15.082960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 21 partno 0 count 1 parts_count 4
2025-10-15T02:28:15.083250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.091723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 4 from KV. Status 1
2025-10-15T02:28:15.091738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T02:28:15.091750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 21 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.091801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:15.091807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.091970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-15T02:28:15.092130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-15T02:28:15.092277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-15T02:28:15.092433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-15T02:28:15.092461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.093811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295638
2025-10-15T02:28:15.093910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-15T02:28:15.093928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295638 WTime 1760495295093
2025-10-15T02:28:15.094054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-15T02:28:15.094072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.094194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-15T02:28:15.094321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-15T02:28:15.094453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-15T02:28:15.094594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-15T02:28:15.094667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-15T02:28:15.095179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 2970343 count 2 nextOffset 23 batches 6
2025-10-15T02:28:15.095195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.095320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-15T02:28:15.095456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-15T02:28:15.095586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-15T02:28:15.095724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-15T02:28:15.095934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-15T02:28:15.096449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 5223541 count 3 nextOffset 24 batches 10
2025-10-15T02:28:15.096471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-15T02:28:15.096600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-15T02:28:15.096749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-15T02:28:15.096890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-15T02:28:15.097093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-15T02:28:15.097589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 7476739 count 4 nextOffset 25 batches 14
2025-10-15T02:28:15.097607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-15T02:28:15.097732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-15T02:28:15.099625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988760
2025-10-15T02:28:15.099761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-15T02:28:15.099901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-15T02:28:15.099952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-15T02:28:15.099969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988760 WTime 1760495295099
2025-10-15T02:28:15.100263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-15T02:28:15.100662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-15T02:28:15.100667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-15T02:28:15.100669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-15T02:28:15.100678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.100791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-15T02:28:15.100982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-15T02:28:15.101469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-15T02:28:15.101552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 18 endOffset 21 curOffset 27 d0000000000_00000000000000000025_00001_0000000002_00007| size 3994387 WTime 1760495295101
2025-10-15T02:28:15.104915Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.104936Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295638
2025-10-15T02:28:15.104943Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988760
2025-10-15T02:28:15.104950Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 2 size 3994387
2025-10-15T02:28:15.106310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 3 size 6759616 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.106353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.106695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.106353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988778
2025-10-15T02:28:15.106725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.106731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.106363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T02:28:15.106374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.106381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-15T02:28:15.106397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-15T02:28:15.106408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-15T02:28:15.106414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-15T02:28:15.106424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-15T02:28:15.106430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-15T02:28:15.106447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-15T02:28:15.106454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-15T02:28:15.106460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-15T02:28:15.106467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-15T02:28:15.106476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-15T02:28:15.106482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-15T02:28:15.106487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-15T02:28:15.106495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-15T02:28:15.106503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.106507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-15T02:28:15.106566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.106569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.106572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.106581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:15.106591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988778 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:15.106595Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.106619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-15T02:28:15.106637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-15T02:28:15.106645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-15T02:28:15.128394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.128409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.128412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.206413Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 Process answer. Aval parts: 1
2025-10-15T02:28:15.207234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.207616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.207992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.208079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:15.208155Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.206200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295638 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.206216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988760 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.206220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 3994387 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.206249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.206329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T02:28:15.206336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-15T02:28:15.206344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 22 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.206348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T02:28:15.206352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-15T02:28:15.206356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-15T02:28:15.206963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.206967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.206970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.207009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:15.207024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 8295638 cause it's been evicted from L2. Actual L1 size: 8
2025-10-15T02:28:15.207027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:15.207030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 22 size 2253220 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:15.207036Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.207050Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.207061Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00000_0000000001_00004?(+) to d0000000000_00000000000000000021_00000_0000000001_00004?(+)
2025-10-15T02:28:15.207064Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000022_00000_0000000001_00004?(+) to d0000000000_00000000000000000022_00000_0000000001_00004?(+)
2025-10-15T02:28:15.207066Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00000_0000000003_00015?(+) to d0000000000_00000000000000000023_00000_0000000003_00015?(+)
2025-10-15T02:28:15.207069Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000026_00003_0000000001_00001?(+) to d0000000000_00000000000000000026_00003_0000000001_00001?(+)
2025-10-15T02:28:15.207072Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000003_00012|(+) to d0000000000_00000000000000000018_00000_0000000003_00012|(+)
2025-10-15T02:28:15.207849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.207862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.207910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-15T02:28:15.210232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.210597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.212102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.213780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.211146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.211170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.211262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-15T02:28:15.211322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-15T02:28:15.211389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-15T02:28:15.211456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-15T02:28:15.211492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-15T02:28:15.211498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-15T02:28:15.211527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.211530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.211542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.211570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.211587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-15T02:28:15.214148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.214697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.214715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.214803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-15T02:28:15.214874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-15T02:28:15.214989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-15T02:28:15.215065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-15T02:28:15.215126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-15T02:28:15.215136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-15T02:28:15.215160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.215170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.215277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.215500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.215594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 321 }
2025-10-15T02:28:15.215610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 24
2025-10-15T02:28:15.215615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.216214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 34 to 34
2025-10-15T02:28:15.216554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.216569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-15T02:28:15.217819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:15.215308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.217896Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: 2025-10-15T02:28:15.215362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 21 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.215373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 26 count 1 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.215393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.215401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.215419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.215423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 21 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.215431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.215439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 26 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-15T02:28:15.215445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.215448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:15.215480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T02:28:15.215493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-15T02:28:15.215496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-15T02:28:15.215500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-15T02:28:15.215505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-15T02:28:15.216439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 2253230 count 1 nextOffset 31 batches 5
2025-10-15T02:28:15.216463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T02:28:15.216473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-15T02:28:15.216476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-15T02:28:15.216479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-15T02:28:15.216482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-15T02:28:15.217090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 0 PackedSize 4506428 count 2 nextOffset 32 batches 9
2025-10-15T02:28:15.217101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.217229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,2 HeadOffset 30 endOffset 30 curOffset 32 d0000000000_00000000000000000030_00000_0000000002_00008? size 4506418 WTime 1760495295216
2025-10-15T02:28:15.217802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:15.218770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.218787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.218864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-15T02:28:15.218935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-15T02:28:15.218994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-15T02:28:15.219078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-15T02:28:15.219126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-15T02:28:15.219137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-15T02:28:15.219155Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.219172Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 0 count 2 size 4506418
2025-10-15T02:28:15.219216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.219238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.222232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 241 }
2025-10-15T02:28:15.222253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 25
2025-10-15T02:28:15.222260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.222364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 104 }
2025-10-15T02:28:15.222370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 26
2025-10-15T02:28:15.222405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 74 }
2025-10-15T02:28:15.222411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 27
2025-10-15T02:28:15.223663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.224020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.224185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 35 to 35
2025-10-15T02:28:15.224178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.224204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.224234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-15T02:28:15.224314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.224470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.224486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-15T02:28:15.225786Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.226018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 13 }
2025-10-15T02:28:15.226032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 28
2025-10-15T02:28:15.226108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 8 }
2025-10-15T02:28:15.226111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 29
2025-10-15T02:28:15.226136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 3 }
2025-10-15T02:28:15.226139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 30
2025-10-15T02:28:15.226536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.226568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.226659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-15T02:28:15.226723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-15T02:28:15.226781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-15T02:28:15.226839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-15T02:28:15.226884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-15T02:28:15.226894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-15T02:28:15.226916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.226948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.227444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.227725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.227877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.227888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.227923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-15T02:28:15.228689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.228050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.229150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 36 to 36
2025-10-15T02:28:15.229422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.229435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-15T02:28:15.230311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.230328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.230407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-15T02:28:15.230476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-15T02:28:15.230582Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-15T02:28:15.230545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.230617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-15T02:28:15.230670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-15T02:28:15.230679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-15T02:28:15.230698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.230727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.231058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.231479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.231622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.231635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.231662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-15T02:28:15.231738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.233735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 37 to 37
2025-10-15T02:28:15.233779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.233796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.233888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-15T02:28:15.233943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-15T02:28:15.234024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-15T02:28:15.234044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.234059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-15T02:28:15.234088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-15T02:28:15.234133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-15T02:28:15.234142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-15T02:28:15.234165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.234194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.235168Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.235702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.236073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.236240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.236254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.236289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-15T02:28:15.236396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.238585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 38 to 38
2025-10-15T02:28:15.238318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.238338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.238406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-15T02:28:15.238449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-15T02:28:15.238497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-15T02:28:15.238540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-15T02:28:15.238719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-15T02:28:15.238724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-15T02:28:15.238742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.238763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.238848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.238913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-15T02:28:15.252083Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.252667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.252994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.253231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.253255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.253293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-15T02:28:15.253408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.255731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.255748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.255829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-15T02:28:15.255880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-15T02:28:15.255939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-15T02:28:15.256020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-15T02:28:15.256071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-15T02:28:15.256081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-15T02:28:15.256104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 39 to 39
2025-10-15T02:28:15.256106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.256147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.256441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.256455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-15T02:28:15.257517Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.258107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.258471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.258682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.258713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.258746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-15T02:28:15.258860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.261266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 40 to 40
2025-10-15T02:28:15.261588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.261598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-15T02:28:15.262229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.262749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:15.262252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.262342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-15T02:28:15.262404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-15T02:28:15.262468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-15T02:28:15.262535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
2025-10-15T02:28:15.262589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-15T02:28:15.262593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-15T02:28:15.262621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.262645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.262802Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.263424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.263729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.263932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.263944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.263964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-15T02:28:15.264133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.266803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.266818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.266889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-15T02:28:15.266939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-15T02:28:15.267000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-15T02:28:15.267055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-15T02:28:15.267089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-15T02:28:15.267093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-15T02:28:15.267115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.267134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.271997Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Got ReadResponse, serverBytesSize = 13517780, now ReadSizeBudget = 0, ReadSizeServerDelta = -12993492
2025-10-15T02:28:15.272136Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-15T02:28:15.272157Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 13517780 to budget
2025-10-15T02:28:15.282072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 2 size 4506418 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.282098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.282118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.282133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-15T02:28:15.282150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-15T02:28:15.282160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-15T02:28:15.282168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-15T02:28:15.282179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-15T02:28:15.282186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-15T02:28:15.282191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-15T02:28:15.282200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-15T02:28:15.282206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282210Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-15T02:28:15.282212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.282216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-15T02:28:15.282271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.282302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.282305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (40)
2025-10-15T02:28:15.282329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T02:28:15.282341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-15T02:28:15.282345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-15T02:28:15.282348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-15T02:28:15.282351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-15T02:28:15.283013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:15.283039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 2253230 count 1 nextOffset 33 batches 5
2025-10-15T02:28:15.283074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T02:28:15.283088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-15T02:28:15.283092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-15T02:28:15.283097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-15T02:28:15.283102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-15T02:28:15.283636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 4506428 count 2 nextOffset 34 batches 9
2025-10-15T02:28:15.283663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T02:28:15.283669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-15T02:28:15.283673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-15T02:28:15.283677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-15T02:28:15.283681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-15T02:28:15.284201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 6759626 count 3 nextOffset 35 batches 13
2025-10-15T02:28:15.284225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T02:28:15.284231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-15T02:28:15.284234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-15T02:28:15.284237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-15T02:28:15.485709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 36 partNo 3 result is x0000000000_00000000000000000032_00000_0000000003_00015? size 8295638
2025-10-15T02:28:15.485744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
2025-10-15T02:28:15.485765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00000_0000000003_00015? new key d0000000000_00000000000000000032_00000_0000000003_00015? size 8295638 WTime 1760495295485
2025-10-15T02:28:15.485983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 1 NewHead: Offset 35 PartNo 3 PackedSize 717145 count 1 nextOffset 36 batches 2
2025-10-15T02:28:15.486006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-15T02:28:15.486020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-15T02:28:15.486024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-15T02:28:15.486028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-15T02:28:15.486032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-15T02:28:15.486544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 3 PackedSize 2970343 count 2 nextOffset 37 batches 6
2025-10-15T02:28:15.486570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T02:28:15.486576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-15T02:28:15.486579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-15T02:28:15.486587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-15T02:28:15.486590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-15T02:28:15.487193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 3 PackedSize 5223541 count 3 nextOffset 38 batches 10
2025-10-15T02:28:15.487207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T02:28:15.487213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-15T02:28:15.487218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-15T02:28:15.487222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-15T02:28:15.487225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-15T02:28:15.487977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 3 PackedSize 7476739 count 4 nextOffset 39 batches 14
2025-10-15T02:28:15.487996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T02:28:15.488003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T02:28:15.601348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 40 partNo 1 result is x0000000000_00000000000000000035_00003_0000000004_00014? size 7988760
2025-10-15T02:28:15.601385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-15T02:28:15.601398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-15T02:28:15.601401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-15T02:28:15.601420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000035_00003_0000000004_00014? new key d0000000000_00000000000000000035_00003_0000000004_00014? size 7988760 WTime 1760495295601
2025-10-15T02:28:15.601763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 1 NewHead: Offset 39 PartNo 1 PackedSize 1741199 count 1 nextOffset 40 batches 4
2025-10-15T02:28:15.601800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.604728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 66 queued_in_partition_duration_ms: 9 }
2025-10-15T02:28:15.604761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 31
2025-10-15T02:28:15.604768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.604884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 65 queued_in_partition_duration_ms: 1 }
2025-10-15T02:28:15.604889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 32
2025-10-15T02:28:15.605220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 41 to 41
2025-10-15T02:28:15.605540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.605556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-15T02:28:15.604274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.604309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.601934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 39,1 HeadOffset 32 endOffset 32 curOffset 40 d0000000000_00000000000000000039_00001_0000000001_00003? size 1741189 WTime 1760495295601
2025-10-15T02:28:15.602201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-15T02:28:15.602204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-15T02:28:15.602207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266034 bytes
2025-10-15T02:28:15.602290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-15T02:28:15.602333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-15T02:28:15.602346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.602351Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.602367Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 3 size 8295638
2025-10-15T02:28:15.602374Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 3 count 4 size 7988760
2025-10-15T02:28:15.602380Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 39 partNo 1 count 1 size 1741189
2025-10-15T02:28:15.602391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T02:28:15.602394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000003_00012?
2025-10-15T02:28:15.602403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00000_0000000002_00008?
2025-10-15T02:28:15.602415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T02:28:15.602480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.602487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 30 partno 0 count 2 parts_count 8 source 1 size 4506418 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.602495Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T02:28:15.602532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63'
2025-10-15T02:28:15.602537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63'
2025-10-15T02:28:15.602548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:15.602553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.602702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-15T02:28:15.602848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-15T02:28:15.602993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-15T02:28:15.603140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-15T02:28:15.603350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-15T02:28:15.603795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-15T02:28:15.603807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-15T02:28:15.603962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-15T02:28:15.604110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-15T02:28:15.604270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-15T02:28:15.604483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-15T02:28:15.649157Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-15T02:28:15.649189Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:15.649240Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-15T02:28:15.649263Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-15T02:28:14.109000Z WriteTime: 2025-10-15T02:28:14.146000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45414", "server": "ipv6:[::1]:45414", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:15.653960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 42 to 42
2025-10-15T02:28:15.654276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.654286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-15T02:28:15.655692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:15.655731Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.654055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.654450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.694958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295604
2025-10-15T02:28:15.694985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295604 WTime 1760495295694
2025-10-15T02:28:15.695014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-15T02:28:15.695027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-15T02:28:15.695191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-15T02:28:15.695337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-15T02:28:15.695497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-15T02:28:15.695571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-15T02:28:15.696125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-15T02:28:15.696134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.696271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-15T02:28:15.696419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-15T02:28:15.696571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-15T02:28:15.696718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-15T02:28:15.696900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-15T02:28:15.697398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 4711514 count 3 nextOffset 31 batches 9
2025-10-15T02:28:15.697406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-15T02:28:15.697537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-15T02:28:15.697687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-15T02:28:15.697976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-15T02:28:15.698044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-15T02:28:15.698576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 6964712 count 4 nextOffset 32 batches 13
2025-10-15T02:28:15.698675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,4 HeadOffset 25 endOffset 27 curOffset 32 d0000000000_00000000000000000028_00004_0000000004_00012| size 6964702 WTime 1760495295698
2025-10-15T02:28:15.775821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.775848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.775880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.775894Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.775910Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295604
2025-10-15T02:28:15.775919Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 6964702
2025-10-15T02:28:15.776172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-15T02:28:15.778235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.781844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.780286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 3 size 8295638 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.780297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 4 size 7988760 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.780301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 39 count 1 size 1741189 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.780340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295638
2025-10-15T02:28:15.780346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T02:28:15.780352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-15T02:28:15.780355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-15T02:28:15.780359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T02:28:15.781087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.781099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.781185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-15T02:28:15.781237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-15T02:28:15.781291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-15T02:28:15.781343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-15T02:28:15.781383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-15T02:28:15.781388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-15T02:28:15.781413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.781439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 18023288 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.781447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-15T02:28:15.781461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-15T02:28:15.781471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-15T02:28:15.781477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-15T02:28:15.781488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-15T02:28:15.781496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-15T02:28:15.781502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-15T02:28:15.781508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-15T02:28:15.781514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-15T02:28:15.781520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-15T02:28:15.781526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-15T02:28:15.781532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-15T02:28:15.781539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-15T02:28:15.781545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-15T02:28:15.781551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-15T02:28:15.781559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-15T02:28:15.781565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-15T02:28:15.781571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-15T02:28:15.781578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-15T02:28:15.781586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-15T02:28:15.781596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-15T02:28:15.781604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-15T02:28:15.781611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-15T02:28:15.781618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-15T02:28:15.781624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-15T02:28:15.781629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-15T02:28:15.781635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-15T02:28:15.781640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-15T02:28:15.781645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-15T02:28:15.781650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-15T02:28:15.781655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-10-15T02:28:15.781661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 1, Offset: 38 is stored on disk
2025-10-15T02:28:15.781666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 2, Offset: 38 is stored on disk
2025-10-15T02:28:15.781671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 3, Offset: 38 is stored on disk
2025-10-15T02:28:15.781677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 4, Offset: 38 is stored on disk
2025-10-15T02:28:15.781681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-10-15T02:28:15.781686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 1, Offset: 39 is stored on disk
2025-10-15T02:28:15.781693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 2, Offset: 39 is stored on disk
2025-10-15T02:28:15.781698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 3, Offset: 39 is stored on disk
2025-10-15T02:28:15.781704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.781707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 4, Offset: 39 is stored on disk
2025-10-15T02:28:15.781752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.781754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.781756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.781767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:15.781778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988760 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:15.781780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:15.781785Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.781796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.781814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.781821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.781823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:15.781865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-15T02:28:15.781878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-15T02:28:15.781880Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-15T02:28:15.781883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-15T02:28:15.781886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-15T02:28:15.782292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 40 PartNo 0 PackedSize 2253230 count 1 nextOffset 41 batches 5
2025-10-15T02:28:15.782304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.782408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 40,1 HeadOffset 40 endOffset 40 curOffset 41 d0000000000_00000000000000000040_00000_0000000001_00004? size 2253220 WTime 1760495295782
2025-10-15T02:28:15.782743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-15T02:28:15.782778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-15T02:28:15.782789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-15T02:28:15.782800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-15T02:28:15.782817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-15T02:28:15.782827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-15T02:28:15.782838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 39
2025-10-15T02:28:15.782847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 40
2025-10-15T02:28:15.782864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.782872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.782882Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.782894Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 40 partNo 0 count 1 size 2253220
2025-10-15T02:28:15.782951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-15T02:28:15.783388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 499 queued_in_partition_duration_ms: 62 }
2025-10-15T02:28:15.783403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 33
2025-10-15T02:28:15.783410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.783770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 43 to 43
2025-10-15T02:28:15.784048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.784058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-15T02:28:15.782182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.782980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.782999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.783324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.785887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.785901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.785979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-15T02:28:15.786042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-15T02:28:15.786103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-15T02:28:15.786175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-15T02:28:15.786213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-15T02:28:15.786223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-15T02:28:15.786248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.786272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.865982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:15.866369Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-15T02:28:15.866392Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-15T02:28:14.123000Z WriteTime: 2025-10-15T02:28:14.150000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "server": "ipv6:[::1]:45414", "_ip": "ipv6:[::1]:45414", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:15.867418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.867440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.867478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-15T02:28:15.869872Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-15T02:28:15.869899Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
2025-10-15T02:28:15.866625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.867054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.867666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.870706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.870723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.870794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-15T02:28:15.870844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-15T02:28:15.870908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-15T02:28:15.870965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-15T02:28:15.870995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-15T02:28:15.870999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-15T02:28:15.871039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.871066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.875858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.888278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 499 queued_in_partition_duration_ms: 55 }
2025-10-15T02:28:15.888312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 34
2025-10-15T02:28:15.888317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.888756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 44 to 44
2025-10-15T02:28:15.889039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.889052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-15T02:28:15.890340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:15.890392Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.891140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 499 queued_in_partition_duration_ms: 51 }
2025-10-15T02:28:15.891159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 35
2025-10-15T02:28:15.891165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage got back to normal 20275218[B]
2025-10-15T02:28:15.891248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 497 queued_in_partition_duration_ms: 50 }
2025-10-15T02:28:15.891252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 36
2025-10-15T02:28:15.891276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 295 queued_in_partition_duration_ms: 247 }
2025-10-15T02:28:15.891279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 37
2025-10-15T02:28:15.891299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 294 queued_in_partition_duration_ms: 230 }
2025-10-15T02:28:15.891304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 38
2025-10-15T02:28:15.891321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 294 queued_in_partition_duration_ms: 224 }
2025-10-15T02:28:15.891324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 39
2025-10-15T02:28:15.891342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 293 queued_in_partition_duration_ms: 220 }
2025-10-15T02:28:15.891344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 40
2025-10-15T02:28:15.891793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.891816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.891848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-15T02:28:15.893506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 45 to 45
2025-10-15T02:28:15.893761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.893770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-15T02:28:15.891110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.891555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.892036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.894708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.894728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.894815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-15T02:28:15.894886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-15T02:28:15.894939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-15T02:28:15.895024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-15T02:28:15.895062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-15T02:28:15.895070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-15T02:28:15.895093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.895115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.895409Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (6-6)
2025-10-15T02:28:15.895427Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:15.895480Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-15T02:28:15.895501Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
2025-10-15T02:28:15.896186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.896195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> Got event: 2025-10-15T02:28:15.896215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-15T02:28:14.144000Z WriteTime: 2025-10-15T02:28:14.401000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45414", "logtype": "unknown", "server": "ipv6:[::1]:45414" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:15.895712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.896000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.896373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.898777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.898793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.898863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-15T02:28:15.898922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-15T02:28:15.898982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-15T02:28:15.899056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-15T02:28:15.899091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-15T02:28:15.899095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-15T02:28:15.899114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.899131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.899509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 46 to 46
2025-10-15T02:28:15.899813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.899827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-15T02:28:15.901132Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:15.901645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.904239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 47 to 47
2025-10-15T02:28:15.904529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.904540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-15T02:28:15.904917Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (7-7)
2025-10-15T02:28:15.904935Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:15.905001Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-15T02:28:15.905024Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
2025-10-15T02:28:15.902016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.902501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.900978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295604 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.900986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 6964702 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.900999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.901320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 2 parts 7 suffix '124' size 3994387
2025-10-15T02:28:15.901326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-15T02:28:15.901330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-15T02:28:15.901335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:15.901338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-15T02:28:15.902127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.902134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-15T02:28:15.902137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00003_0000000004_00014?
2025-10-15T02:28:15.902140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 16284398 bytes
2025-10-15T02:28:15.902154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:15.902156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 3994387 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:15.902159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 6759616 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T02:28:15.902162Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.902196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.902200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.902208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-15T02:28:15.902211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000032_00000_0000000003_00015?
2025-10-15T02:28:15.902221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00003_0000000004_00014?
2025-10-15T02:28:15.902232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-15T02:28:15.902375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.902378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 3 count 4 parts_count 14 source 1 size 7988760 accessed 0 times before, last time 2025-10-15T02:28:15.000000Z
2025-10-15T02:28:15.902383Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-15T02:28:15.902417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-15T02:28:15.902424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:15.902427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.902429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63'
2025-10-15T02:28:15.902433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 4 parts 14 suffix '63'
2025-10-15T02:28:15.902597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-15T02:28:15.902746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-15T02:28:15.902899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-15T02:28:15.904195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 33 partNo 2 result is x0000000000_00000000000000000028_00004_0000000004_00014 size 7988738
2025-10-15T02:28:15.904338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-15T02:28:15.904556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-15T02:28:15.904568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000028_00004_0000000004_00014 new key d0000000000_00000000000000000028_00004_0000000004_00014 size 7988738 WTime 1760495295904
2025-10-15T02:28:15.904774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 33 partNo 4 FormedBlobsCount 1 NewHead: Offset 32 PartNo 2 PackedSize 1229172 count 1 nextOffset 33 batches 3
2025-10-15T02:28:15.904781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-15T02:28:15.904928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-15T02:28:15.905068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-15T02:28:15.905224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-15T02:28:15.905452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-15T02:28:15.906521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 3482370 count 2 nextOffset 34 batches 7
2025-10-15T02:28:15.907066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:15.907419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:15.906588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-15T02:28:15.906730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-15T02:28:15.906868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-15T02:28:15.907006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-15T02:28:15.907074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-15T02:28:15.907606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 5735568 count 3 nextOffset 35 batches 11
2025-10-15T02:28:15.907997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-15T02:28:15.908001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-15T02:28:15.908004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-15T02:28:15.908012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:15.908144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-15T02:28:15.908324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-15T02:28:14.151000Z WriteTime: 2025-10-15T02:28:14.431000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45414", "server": "ipv6:[::1]:45414", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:15.921402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 32 PartNo 2 PackedSize 7988766 count 4 nextOffset 36 batches 15
2025-10-15T02:28:15.921434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-15T02:28:15.927831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 48 to 48
2025-10-15T02:28:15.928176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:15.928190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-15T02:28:15.946305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:94: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 37 partNo 0 result is x0000000000_00000000000000000032_00002_0000000004_00014 size 7988756
2025-10-15T02:28:15.946467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-15T02:28:15.970868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-15T02:28:15.971044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-15T02:28:15.971258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-15T02:28:15.971291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000032_00002_0000000004_00014 new key d0000000000_00000000000000000032_00002_0000000004_00014 size 7988756 WTime 1760495295971
2025-10-15T02:28:15.971732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 37 partNo 4 FormedBlobsCount 1 NewHead: Offset 36 PartNo 0 PackedSize 2253230 count 1 nextOffset 37 batches 5
2025-10-15T02:28:15.971749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-15T02:28:15.971879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-15T02:28:15.972012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-15T02:28:15.972144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-15T02:28:15.972330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-15T02:28:15.980143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 4506428 count 2 nextOffset 38 batches 9
2025-10-15T02:28:15.980162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-15T02:28:15.980301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-15T02:28:15.980441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-15T02:28:15.980571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-15T02:28:15.980637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-15T02:28:15.981119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:133: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 36 PartNo 0 PackedSize 6759626 count 3 nextOffset 39 batches 13
2025-10-15T02:28:15.981262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-15T02:28:15.981359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:563: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 36,3 HeadOffset 28 endOffset 32 curOffset 39 d0000000000_00000000000000000036_00000_0000000003_00012| size 6759616 WTime 1760495295981
2025-10-15T02:28:15.983283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.983305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.983392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-15T02:28:15.983452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-15T02:28:15.983511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-15T02:28:15.983565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-15T02:28:15.983593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-15T02:28:15.983615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-15T02:28:15.983646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.983656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.983674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.983685Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.983700Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 4 size 7988738
2025-10-15T02:28:15.983714Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 2 count 4 size 7988756
2025-10-15T02:28:15.983726Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 36 partNo 0 count 3 size 6759616
2025-10-15T02:28:15.983748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 40 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:15.983775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.983802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:15.983812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-15T02:28:15.983857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:15.983877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:15.983887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.983901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-10-15T02:28:15.983905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.983909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 1, Offset: 40 is stored on disk
2025-10-15T02:28:15.983911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.983916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 2, Offset: 40 is stored on disk
2025-10-15T02:28:15.983918Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.983923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 3, Offset: 40 is stored on disk
2025-10-15T02:28:15.983928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:15.983938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 4, Offset: 40 is stored on disk
2025-10-15T02:28:15.983970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:15.984002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:15.984009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-15T02:28:15.984030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-15T02:28:15.984045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-15T02:28:15.984049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-15T02:28:15.984054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-15T02:28:15.984056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-15T02:28:15.984452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 2253230 count 1 nextOffset 42 batches 5
2025-10-15T02:28:15.984480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-15T02:28:15.984488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-15T02:28:15.984492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-15T02:28:15.984495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-15T02:28:15.984499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-15T02:28:15.984989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 4506428 count 2 nextOffset 43 batches 9
2025-10-15T02:28:15.985002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-15T02:28:15.985008Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-15T02:28:15.985012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-15T02:28:15.985015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-15T02:28:15.985017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-15T02:28:15.985617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 0 PackedSize 6759626 count 3 nextOffset 44 batches 13
2025-10-15T02:28:15.985632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-15T02:28:15.985638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-15T02:28:15.985641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-15T02:28:15.985644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-15T02:28:15.985882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T02:28:15.985889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295604
2025-10-15T02:28:15.985894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:15.987160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 45 partNo 3 result is x0000000000_00000000000000000041_00000_0000000003_00015? size 8295638
2025-10-15T02:28:15.987179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-15T02:28:15.987191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000041_00000_0000000003_00015? new key d0000000000_00000000000000000041_00000_0000000003_00015? size 8295638 WTime 1760495295986
2025-10-15T02:28:15.987581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 1 NewHead: Offset 44 PartNo 3 PackedSize 717145 count 1 nextOffset 45 batches 2
2025-10-15T02:28:15.987591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-15T02:28:15.987597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-15T02:28:15.987602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-15T02:28:15.987606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-15T02:28:15.987609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-15T02:28:15.988074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 44 PartNo 3 PackedSize 2970343 count 2 nextOffset 46 batches 6
2025-10-15T02:28:15.988085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:15.988189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 44,2 HeadOffset 41 endOffset 41 curOffset 46 d0000000000_00000000000000000044_00003_0000000002_00005? size 2970333 WTime 1760495295987
2025-10-15T02:28:15.988577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:15.988659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 41
2025-10-15T02:28:15.988688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295604 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T02:28:15.988691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 39 size 1741189 cause it's been evicted from L2. Actual L1 size: 4
2025-10-15T02:28:15.988694Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:15.988705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-15T02:28:15.988710Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:15.988722Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 41 partNo 0 count 3 size 8295638
2025-10-15T02:28:15.988730Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 44 partNo 3 count 2 size 2970333
2025-10-15T02:28:15.988737Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00012?(+) to d0000000000_00000000000000000027_00000_0000000003_00012?(+)
2025-10-15T02:28:15.988740Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000030_00000_0000000002_00008?(+) to d0000000000_00000000000000000030_00000_0000000002_00008?(+)
2025-10-15T02:28:15.988742Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00001_0000000002_00007|(+) to d0000000000_00000000000000000025_00001_0000000002_00007|(+)
2025-10-15T02:28:15.988812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.988850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:15.995471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:15.995492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:15.995589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-15T02:28:15.995661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-15T02:28:15.995742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-15T02:28:15.995816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-15T02:28:15.995851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-15T02:28:15.995859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-15T02:28:15.995881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:15.995907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:16.032578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:16.033039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:16.033354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:16.033376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:16.033424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-15T02:28:16.033900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.040188Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.040439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:16.040466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:16.040746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-15T02:28:16.041100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-15T02:28:16.041173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-15T02:28:16.041246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-15T02:28:16.041301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-15T02:28:16.041315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-15T02:28:16.041346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:16.041375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:16.041905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 201 }
2025-10-15T02:28:16.041921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 41
2025-10-15T02:28:16.075544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 49 to 49
2025-10-15T02:28:16.083826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:16.098757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.098783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 49
2025-10-15T02:28:16.098504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 4 size 7988738 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.098527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 4 size 7988756 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.098532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 36 count 3 size 6759616 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.098586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:16.098620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T02:28:16.098632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-15T02:28:16.098667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T02:28:16.098675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T02:28:16.098678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T02:28:16.108848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2306: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-15T02:28:16.108874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:190: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-15T02:28:16.108920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 8295638 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:16.108924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 6964702 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T02:28:16.108949Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:16.125285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 41 count 3 size 8295638 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.125300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 44 count 2 size 2970333 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.125318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:16.125332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 3 count 4 parts 14 suffix '63' size 7988760
2025-10-15T02:28:16.125339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T02:28:16.125341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:16.125345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:16.125349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-15T02:28:16.125354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 44 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-15T02:28:16.125362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-10-15T02:28:16.125368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 1, Offset: 41 is stored on disk
2025-10-15T02:28:16.125378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 2, Offset: 41 is stored on disk
2025-10-15T02:28:16.125388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 3, Offset: 41 is stored on disk
2025-10-15T02:28:16.125402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 4, Offset: 41 is stored on disk
2025-10-15T02:28:16.125408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-10-15T02:28:16.125414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 1, Offset: 42 is stored on disk
2025-10-15T02:28:16.125420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 2, Offset: 42 is stored on disk
2025-10-15T02:28:16.125426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 3, Offset: 42 is stored on disk
2025-10-15T02:28:16.125432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 4, Offset: 42 is stored on disk
2025-10-15T02:28:16.125439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125443Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-10-15T02:28:16.125444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 1, Offset: 43 is stored on disk
2025-10-15T02:28:16.125451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 2, Offset: 43 is stored on disk
2025-10-15T02:28:16.125460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 3, Offset: 43 is stored on disk
2025-10-15T02:28:16.125467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 4, Offset: 43 is stored on disk
2025-10-15T02:28:16.125472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-10-15T02:28:16.125478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 1, Offset: 44 is stored on disk
2025-10-15T02:28:16.125483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 2, Offset: 44 is stored on disk
2025-10-15T02:28:16.125488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 3, Offset: 44 is stored on disk
2025-10-15T02:28:16.125494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 4, Offset: 44 is stored on disk
2025-10-15T02:28:16.125501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-10-15T02:28:16.125508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 1, Offset: 45 is stored on disk
2025-10-15T02:28:16.125514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 2, Offset: 45 is stored on disk
2025-10-15T02:28:16.125520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 3, Offset: 45 is stored on disk
2025-10-15T02:28:16.125527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.125530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 4, Offset: 45 is stored on disk
2025-10-15T02:28:16.125600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:16.125614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:16.125617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-15T02:28:16.125646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-15T02:28:16.125659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-15T02:28:16.125663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-15T02:28:16.125667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-15T02:28:16.125670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-15T02:28:16.127772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 2253230 count 1 nextOffset 47 batches 5
2025-10-15T02:28:16.127829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-15T02:28:16.127840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-15T02:28:16.127846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-15T02:28:16.127850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-15T02:28:16.127853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-15T02:28:16.128813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 46 PartNo 0 PackedSize 4506428 count 2 nextOffset 48 batches 9
2025-10-15T02:28:16.128829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:16.128942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 46,2 HeadOffset 46 endOffset 46 curOffset 48 d0000000000_00000000000000000046_00000_0000000002_00008? size 4506418 WTime 1760495296128
2025-10-15T02:28:16.131191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:16.131204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:16.131207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:16.131209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:16.131212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 15260380 bytes
2025-10-15T02:28:16.131270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 40 size 2253220 cause it's been evicted from L2. Actual L1 size: 6
2025-10-15T02:28:16.131278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 7988738 cause it's been evicted from L2. Actual L1 size: 5
2025-10-15T02:28:16.131281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 35 size 7988760 cause it's been evicted from L2. Actual L1 size: 4
2025-10-15T02:28:16.131285Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:16.131315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 42
2025-10-15T02:28:16.131352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
2025-10-15T02:28:16.131378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 44
2025-10-15T02:28:16.131396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 45
2025-10-15T02:28:16.131415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 46
2025-10-15T02:28:16.131531Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:16.131550Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 46 partNo 0 count 2 size 4506418
2025-10-15T02:28:16.131517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.131556Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000032_00000_0000000003_00015?(+) to d0000000000_00000000000000000032_00000_0000000003_00015?(+)
2025-10-15T02:28:16.131562Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000035_00003_0000000004_00014?(+) to d0000000000_00000000000000000035_00003_0000000004_00014?(+)
2025-10-15T02:28:16.131563Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000028_00004_0000000004_00012|(+) to d0000000000_00000000000000000028_00004_0000000004_00012|(+)
2025-10-15T02:28:16.131571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-15T02:28:16.131574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:16.131582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:16.131592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:16.131604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:16.131552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.131560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.131567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.131614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-15T02:28:16.131673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 1 count 1 parts_count 3 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.131680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 40 partno 0 count 1 parts_count 4 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.131685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 41 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-15T02:28:16.000000Z
2025-10-15T02:28:16.131689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 44 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-15T02:28:16.000000Z
2025-10-15T02:28:16.131705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 4 from KV
2025-10-15T02:28:16.131726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 15 suffix '63'
2025-10-15T02:28:16.131732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 44 partno 3 count 2 parts 5 suffix '63'
2025-10-15T02:28:16.131737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 1 count 1 parts_count 3
2025-10-15T02:28:16.131739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 40 partno 0 count 1 parts_count 4
2025-10-15T02:28:16.131890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.146702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 141 queued_in_partition_duration_ms: 198 }
2025-10-15T02:28:16.146720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 42
2025-10-15T02:28:16.168293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 140 queued_in_partition_duration_ms: 114 }
2025-10-15T02:28:16.168310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 43
2025-10-15T02:28:16.168382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 140 queued_in_partition_duration_ms: 92 }
2025-10-15T02:28:16.168385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 44
2025-10-15T02:28:16.169335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:16.169744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:16.170066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:16.170086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:16.170131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 49
2025-10-15T02:28:16.171182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 139 queued_in_partition_duration_ms: 86 }
2025-10-15T02:28:16.171194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 45
2025-10-15T02:28:16.171261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 137 queued_in_partition_duration_ms: 4 }
2025-10-15T02:28:16.171264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 46
2025-10-15T02:28:16.170403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.178593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 46 count 2 size 4506418 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.178657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:16.178660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 46 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-15T02:28:16.178687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:16.178696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-10-15T02:28:16.178723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 1, Offset: 46 is stored on disk
2025-10-15T02:28:16.178746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 2, Offset: 46 is stored on disk
2025-10-15T02:28:16.178754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 3, Offset: 46 is stored on disk
2025-10-15T02:28:16.178767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 4, Offset: 46 is stored on disk
2025-10-15T02:28:16.178775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-10-15T02:28:16.178784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 1, Offset: 47 is stored on disk
2025-10-15T02:28:16.178794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178800Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 2, Offset: 47 is stored on disk
2025-10-15T02:28:16.178802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 3, Offset: 47 is stored on disk
2025-10-15T02:28:16.178808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.178812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 4, Offset: 47 is stored on disk
2025-10-15T02:28:16.181776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:16.181790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:16.181792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:16.181807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:16.182068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 47
2025-10-15T02:28:16.182101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 48
2025-10-15T02:28:16.184958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.184987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.185269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 53 queued_in_partition_duration_ms: 129 }
2025-10-15T02:28:16.185282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 47
2025-10-15T02:28:16.185368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 50 queued_in_partition_duration_ms: 89 }
2025-10-15T02:28:16.185373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 48
2025-10-15T02:28:16.186162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:16.186175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:16.186178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:16.191084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:16.191110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:16.191190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size: 511959
2025-10-15T02:28:16.191243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 97 size: 511959
2025-10-15T02:28:16.191302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 97 size: 511959
2025-10-15T02:28:16.191351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 97 size: 511959
2025-10-15T02:28:16.191405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size: 205040
2025-10-15T02:28:16.191410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 97 size 205040 offset: -1
2025-10-15T02:28:16.191441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:16.191468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:16.191478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:16.191480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-15T02:28:16.191517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-10-15T02:28:16.191532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 1
2025-10-15T02:28:16.191534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 2
2025-10-15T02:28:16.191537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 3
2025-10-15T02:28:16.191540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 4
2025-10-15T02:28:16.192371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 4 FormedBlobsCount 0 NewHead: Offset 48 PartNo 0 PackedSize 2253230 count 1 nextOffset 49 batches 5
2025-10-15T02:28:16.192384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:16.192494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 48,1 HeadOffset 48 endOffset 48 curOffset 49 d0000000000_00000000000000000048_00000_0000000001_00004? size 2253220 WTime 1760495296192
2025-10-15T02:28:16.192789Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:16.192801Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 48 partNo 0 count 1 size 2253220
2025-10-15T02:28:16.203101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 48 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.203138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2154: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-15T02:28:16.203160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252911 WriteNewSizeFromSupportivePartitions# 0
2025-10-15T02:28:16.203168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.203180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-10-15T02:28:16.203191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.203194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 1, Offset: 48 is stored on disk
2025-10-15T02:28:16.203198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.203201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 2, Offset: 48 is stored on disk
2025-10-15T02:28:16.203203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.203206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 3, Offset: 48 is stored on disk
2025-10-15T02:28:16.203212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-15T02:28:16.203216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 4, Offset: 48 is stored on disk
2025-10-15T02:28:16.203257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:16.203259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:16.203261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:16.203272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:175: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-15T02:28:16.203291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 49
2025-10-15T02:28:16.203334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 48 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:16.203461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:16.206026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 11 }
2025-10-15T02:28:16.206043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: acknoledged message 49
2025-10-15T02:28:16.242979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 4 from KV. Status 1
2025-10-15T02:28:16.242994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T02:28:16.242998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T02:28:16.243010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 1741189 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.243015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 40 count 1 size 2253220 actorID [2:7561269705065249365:2400]
2025-10-15T02:28:16.243075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:16.243090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:16.243238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T02:28:16.243390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-15T02:28:16.243524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-15T02:28:16.245768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 32 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-15T02:28:16.245776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T02:28:16.245781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:16.247537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
2025-10-15T02:28:16.250815Z :DEBUG: [/Root] Take Data. Partition 0. Read: {4, 0} (8-8)
2025-10-15T02:28:16.250844Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:16.251041Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-15T02:28:16.251062Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-15T02:28:14.218000Z WriteTime: 2025-10-15T02:28:14.434000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:45414", "logtype": "unknown", "_ip": "ipv6:[::1]:45414", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:16.275099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 50 to 50
2025-10-15T02:28:16.375130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.375165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 50
2025-10-15T02:28:16.380660Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.383279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 51 to 51
2025-10-15T02:28:16.383573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.383585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 51
2025-10-15T02:28:16.394359Z :DEBUG: [/Root] Take Data. Partition 0. Read: {5, 0} (9-9)
2025-10-15T02:28:16.394655Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-15T02:28:16.396924Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] In ContinueReadingDataImpl, ReadSizeBudget = 13517780, ReadSizeServerDelta = -12993492
2025-10-15T02:28:16.397970Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-15T02:28:16.397991Z :DEBUG: [/Root] [/Root] [c46861f4-2d151451-ecf0d267-d274c137] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-15T02:28:14.225000Z WriteTime: 2025-10-15T02:28:14.462000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:45414", "server": "ipv6:[::1]:45414", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-15T02:28:16.479253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 52 to 52
2025-10-15T02:28:16.483038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:16.484249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:16.493353Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 grpc read done: success# 1, data# { read_request { bytes_size: 13517780 } }
2025-10-15T02:28:16.493480Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 got read request: guid# efa28c7a-495929eb-18122ac8-736c9166
2025-10-15T02:28:16.493559Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 performing read request: guid# eb525910-7c8ca864-767ccd51-59acae31, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 14, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-15T02:28:16.493633Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 14 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 22 ClientCommitOffset 0 committedOffset 0 Guid eb525910-7c8ca864-767ccd51-59acae31
2025-10-15T02:28:16.551143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.551168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 52
2025-10-15T02:28:16.552939Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.560037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 53 to 53
2025-10-15T02:28:16.560320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.560333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 53
2025-10-15T02:28:16.561491Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.567291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 54 to 54
2025-10-15T02:28:16.567624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.567638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 54
2025-10-15T02:28:16.569963Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.577640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 55 to 55
2025-10-15T02:28:16.623369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.623393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 55
2025-10-15T02:28:16.624570Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.628121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 56 to 56
2025-10-15T02:28:16.628404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.628417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 56
2025-10-15T02:28:16.636479Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.639950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 57 to 57
2025-10-15T02:28:16.641082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.641095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 57
2025-10-15T02:28:16.644322Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.651899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 58 to 58
2025-10-15T02:28:16.652204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.652217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 58
2025-10-15T02:28:16.656486Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
2025-10-15T02:28:16.661121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write 1 messages with Id from 59 to 59
2025-10-15T02:28:16.661430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: try to update token
2025-10-15T02:28:16.661447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Send 1 message(s) (0 left), first sequence number is 59
2025-10-15T02:28:16.662182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-15T02:28:16.662230Z :NOTICE: [/Invalid] [/Invalid] [6e3d4b-fb5c3943-ca476f6-46ba35d1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:29296" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:29296. " }
E1015 02:28:17.138269790 3835046 chttp2_transport.cc:1143]             ipv4:127.0.0.1:27659: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T02:28:17.184277Z node 2 :PERSQUEUE CRIT: actor.h:46: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=valueD.size() <= MaxBlobSize && (valueD.size() + size + 1_MB > MaxBlobSize || HeadSize + BlobsSize + size + GetMaxHeaderSize() <= MaxBlobSize);fline=blob.cpp:532;
??+0 (0x14937C3F)
??+0 (0x14937BE7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x1569C71D)
NKikimr::NPQ::TPartitionedBlob::CreateFormedBlob(unsigned int, bool)+2949 (0x244C54A5)
NKikimr::NPQ::TPartitionedBlob::Add(NKikimr::NPQ::TClientBlob&&)+213 (0x244C5C05)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+3114 (0x245B001A)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x245B5155)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3979 (0x245B66EB)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+5681 (0x24462581)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15648778)
??+0 (0x14937C3F)
??+0 (0x14937E14)
std::rethrow_exception(std::exception_ptr)+12 (0x1494918C)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1744F3E1)
2025-10-15T02:28:17.185128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 32 size 7988756 cause it's been evicted from L2. Actual L1 size: 7
2025-10-15T02:28:17.185136Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-15T02:28:17.185196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:17.185207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:17.185607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:17.185611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:17.186064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_8135371593314820448_v1
2025-10-15T02:28:17.186092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98 requestId: <none> error: tablet will be restarted right now
2025-10-15T02:28:17.186099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-15T02:28:17.186194Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_8135371593314820448_v1
2025-10-15T02:28:17.187304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-15T02:28:17.187319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session will restart in 0.007572s
2025-10-15T02:28:17.187361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: Do CDS request
2025-10-15T02:28:17.187368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Start write session. Will connect to endpoint: localhost:29296
2025-10-15T02:28:17.186283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7561269708810230036:2494]
2025-10-15T02:28:17.186283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-15T02:28:17.186356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-15T02:28:17.186359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-15T02:28:17.186408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: error at write: Disconnected sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0
2025-10-15T02:28:17.187028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|d5c04743-7e55f355-1229f494-ed55dae7_0 is DEAD
2025-10-15T02:28:17.196525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T02:28:17.196716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-15T02:28:17.196735Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-15T02:28:17.197018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-15T02:28:17.197075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:45414
2025-10-15T02:28:17.197081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45414 proto=v1  topic=test-topic durationSec=0
2025-10-15T02:28:17.197087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-15T02:28:17.198074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-15T02:28:17.198157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-15T02:28:17.198160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-15T02:28:17.198312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-15T02:28:17.198324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-15T02:28:17.199224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-15T02:28:17.203173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T02:28:17.209887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-15T02:28:17.209904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-15T02:28:17.209907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-15T02:28:17.209915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-15T02:28:17.217768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-15T02:28:17.222886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-15T02:28:17.223262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-15T02:28:17.223275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-15T02:28:17.223290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-15T02:28:17.223376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-15T02:28:17.223492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1092: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7561269726540086366:2474]
2025-10-15T02:28:17.224206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-15T02:28:17.227393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-15T02:28:17.227478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-15T02:28:17.228486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-15T02:28:17.229202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T02:28:17.229212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T02:28:17.229213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T02:28:17.229215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T02:28:17.229216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T02:28:17.229218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T02:28:17.229219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T02:28:17.229220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T02:28:17.229222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T02:28:17.229223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[9]: d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T02:28:17.229225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[10]: d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T02:28:17.229226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[11]: d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:17.229227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[12]: d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:17.229229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[13]: d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:17.229230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[14]: d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:17.229231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[15]: d0000000000_00000000000000000046_00000_0000000002_00008?
2025-10-15T02:28:17.229232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:556: key[16]: d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-15T02:28:17.229241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:564: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T02:28:17.229252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T02:28:17.229256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T02:28:17.229260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T02:28:17.229264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T02:28:17.229267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T02:28:17.229271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T02:28:17.229274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T02:28:17.229278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T02:28:17.229282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T02:28:17.229285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T02:28:17.229289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:17.229292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:17.229298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:17.229301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:17.229304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000046_00000_0000000002_00008?
2025-10-15T02:28:17.229308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:606: add key d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-15T02:28:17.229318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T02:28:17.229327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-15T02:28:17.229334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T02:28:17.229340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-15T02:28:17.229344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T02:28:17.229349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-15T02:28:17.229356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T02:28:17.229378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-15T02:28:17.229403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T02:28:17.229415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-15T02:28:17.229420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T02:28:17.229424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-15T02:28:17.229429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T02:28:17.229433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-15T02:28:17.229437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T02:28:17.229442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-15T02:28:17.229447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T02:28:17.229451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-10-15T02:28:17.229455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T02:28:17.229460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 4 size 7988756 so 0 eo 36 d0000000000_00000000000000000032_00002_0000000004_00014
2025-10-15T02:28:17.229465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T02:28:17.229469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 3 size 6759616 so 0 eo 39 d0000000000_00000000000000000036_00000_0000000003_00012|
2025-10-15T02:28:17.229474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:17.229479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 39 count 1 size 1741189 so 0 eo 40 d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:17.229483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:17.229489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 40 count 1 size 2253220 so 0 eo 41 d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:17.229493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:17.229497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 3 size 8295638 so 0 eo 44 d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:17.229502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:17.229507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 44 count 2 size 2970333 so 0 eo 46 d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:17.229511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000046_00000_0000000002_00008?
2025-10-15T02:28:17.229516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 46 count 2 size 4506418 so 0 eo 48 d0000000000_00000000000000000046_00000_0000000002_00008?
2025-10-15T02:28:17.229521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:662: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-15T02:28:17.229525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:692: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 48 count 1 size 2253220 so 0 eo 49 d0000000000_00000000000000000048_00000_0000000001_00004?
2025-10-15T02:28:17.229586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-15T02:28:17.286688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 1 ReadOffset 10 EndOffset 22 InitDone 1 WaitForData 0, pipe: [1:7561269725990099626:2494]
2025-10-15T02:28:17.286878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:396: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) resend { PartitionRequest { Topic: "/Root/PQ/rt3.dc1--test-topic" Partition: 0 CmdRead { ClientId: "user" SessionId: "shared/user_1_1_8135371593314820448_v1" Offset: 10 Count: 14 Bytes: 524288 TimeoutMs: 1000 ClientDC: "dc1" } PipeClient { RawX1: 7561269708810230036 RawX2: 4503603922340286 } Cookie: 10 } }
2025-10-15T02:28:17.294585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:916: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 36 endOffset 49 key 36,3 valuesize 6759616 expected 6759616
2025-10-15T02:28:17.299910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-15T02:28:17.299932Z node 2 :PERSQUEUE INFO: partition_init.cpp:965: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-15T02:28:17.299936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:81: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-15T02:28:17.299941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:61: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-15T02:28:17.299951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7561269726540086366:2474]
2025-10-15T02:28:17.299972Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 49 Head Offset 49 PartNo 0 PackedSize 0 count 0 nextOffset 49 batches 0
SYNC INIT sourceId  src_id seqNo 49 offset 48
SYNC INIT DATA KEY: d0000000000_00000000000000000039_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000040_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000044_00003_0000000002_00005? size 2970333
SYNC INIT DATA KEY: d0000000000_00000000000000000046_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000048_00000_0000000001_00004? size 2253220
2025-10-15T02:28:17.299998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4311: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-15T02:28:17.300003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.300006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.300009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.300029Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 49 offset: 48 MaxOffset: 49
2025-10-15T02:28:17.300036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-15T02:28:17.300047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-15T02:28:17.300128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:17.300140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:17.300526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-15T02:28:17.300567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-15T02:28:17.300616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_8135371593314820448_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7561269725990099626:2494]
2025-10-15T02:28:17.300142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:17.300144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:205: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:17.300147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 15260380 bytes
2025-10-15T02:28:17.300233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:227: [72075186224037892][Partition][0][StateIdle] Begin compaction for 4 blobs
2025-10-15T02:28:17.300235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000039_00001_0000000001_00003?
2025-10-15T02:28:17.300252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000040_00000_0000000001_00004?
2025-10-15T02:28:17.300264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000041_00000_0000000003_00015?
2025-10-15T02:28:17.300282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:240: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000044_00003_0000000002_00005?
2025-10-15T02:28:17.300292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:264: [72075186224037892][Partition][0][StateIdle] Request 4 blobs for compaction
2025-10-15T02:28:17.300313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269725990099614:2542], now have 1 active actors on pipe
2025-10-15T02:28:17.300317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269725990099626:2494], now have 1 active actors on pipe
2025-10-15T02:28:17.300320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7561269725990099567:2450], now have 1 active actors on pipe
2025-10-15T02:28:17.300327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 39 partno 1 count 1 parts_count 3 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 40 partno 0 count 1 parts_count 4 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 41 partno 0 count 3 parts_count 15 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 44 partno 3 count 2 parts_count 5 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 4 of 4 from KV
2025-10-15T02:28:17.300376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 49 max time lag 0ms effective offset 0
2025-10-15T02:28:17.300392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 49
2025-10-15T02:28:17.300395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-15T02:28:17.300405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 39 partno 1 count 1 parts_count 3
2025-10-15T02:28:17.300408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 40 partno 0 count 1 parts_count 4
2025-10-15T02:28:17.300410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 41 partno 0 count 3 parts_count 15
2025-10-15T02:28:17.300412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 44 partno 3 count 2 parts_count 5
2025-10-15T02:28:17.300445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-15T02:28:17.300471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-15T02:28:17.300678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:17.300684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:17.300714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:17.300717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:17.300755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d35f8afe-819309fb-33f4febf-6528fa20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-15T02:28:17.300763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.300767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.300770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-15T02:28:17.300781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.300792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-15T02:28:17.300814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:17.300842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 14 size 524288 endOffset 49 max time lag 0ms effective offset 10
2025-10-15T02:28:17.300871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 2 blobs, size 7988760 count 4 last offset 10, current partition end offset: 49
2025-10-15T02:28:17.300873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-15T02:28:17.300878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.300888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 4. Have to read 2 of 2 from KV
2025-10-15T02:28:17.300893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-10-15T02:28:17.300895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
2025-10-15T02:28:17.301500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:17.301514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:17.301553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-15T02:28:17.301700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 49 sessionId: src_id|d35f8afe-819309fb-33f4febf-6528fa20_0
2025-10-15T02:28:17.302328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5c04743-7e55f355-1229f494-ed55dae7_0] Write session established. Init response: last_sequence_number: 49 session_id: "src_id|d35f8afe-819309fb-33f4febf-6528fa20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-15T02:28:17.398644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.398660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.398664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.458317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f8afe-819309fb-33f4febf-6528fa20_0] Write session: try to update token
2025-10-15T02:28:17.458338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f8afe-819309fb-33f4febf-6528fa20_0] Send 10 message(s) (0 left), first sequence number is 50
2025-10-15T02:28:17.498975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.498993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.499000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.599314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.599333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.599337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.699700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.699731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.699735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.715694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-15T02:28:17.715713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T02:28:17.715724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:17.715775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-15T02:28:17.715786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 3 parts 12 suffix '124' size 6759616
2025-10-15T02:28:17.715799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-15T02:28:17.716050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-15T02:28:17.716197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:17.716345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:17.716487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-15T02:28:17.716686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-15T02:28:17.716735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1760495293883 queuesize 0 startOffset 0
2025-10-15T02:28:17.802021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.802037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.802040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:17.902410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:17.902426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:17.902430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:18.003414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:18.003431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:18.003434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:18.103651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:18.103668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:18.103679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:18.151713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|d35f8afe-819309fb-33f4febf-6528fa20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-15T02:28:18.204001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:18.204016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:18.204020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:18.274080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:18.274103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:18.274146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-15T02:28:18.272747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-15T02:28:18.277989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-15T02:28:18.304346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:18.304361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:18.304364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:18.327422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7561269725990099575:2542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-15T02:28:18.345893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-15T02:28:18.345927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-15T02:28:18.346135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.346324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.346425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.346513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.346631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.346642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.346763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.346877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.346960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.347044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.347185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.347193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.347282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.347359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.347431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.347499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.347636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.347644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.347719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.347793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.347863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.347932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.348095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.348098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.348166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.348219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.348272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.348344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.349065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.349076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.349147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.349213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.349267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.349330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.349673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.349676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.349780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.349853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.349917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.349981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.350323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.350325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.350412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.350479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.350670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.350814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.350888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.350890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.350975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.351139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.351218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.351288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.351337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.351340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.351420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 1 size: 511959
2025-10-15T02:28:18.351486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 1 messageNo: 1 size: 511959
2025-10-15T02:28:18.351552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 2 messageNo: 1 size: 511959
2025-10-15T02:28:18.351739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 3 messageNo: 1 size: 511959
2025-10-15T02:28:18.351847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 4 messageNo: 1 size: 205040
2025-10-15T02:28:18.351850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-15T02:28:18.351933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-15T02:28:18.352195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2327: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-15T02:28:18.352222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2336: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-15T02:28:18.352226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2340: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-15T02:28:18.352265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-10-15T02:28:18.352285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 1
2025-10-15T02:28:18.352292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 2
2025-10-15T02:28:18.352295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 3
2025-10-15T02:28:18.352298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 4
2025-10-15T02:28:18.353637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 0 PackedSize 2253230 count 1 nextOffset 50 batches 5
2025-10-15T02:28:18.353662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-10-15T02:28:18.353670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 1
2025-10-15T02:28:18.353674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 2
2025-10-15T02:28:18.353678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 3
2025-10-15T02:28:18.353681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 4
2025-10-15T02:28:18.354757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 0 PackedSize 4506428 count 2 nextOffset 51 batches 9
2025-10-15T02:28:18.354779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-10-15T02:28:18.354785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 1
2025-10-15T02:28:18.354789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 2
2025-10-15T02:28:18.354792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 3
2025-10-15T02:28:18.354802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 4
2025-10-15T02:28:18.355409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 4 FormedBlobsCount 0 NewHead: Offset 49 PartNo 0 PackedSize 6759626 count 3 nextOffset 52 batches 13
2025-10-15T02:28:18.355431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-10-15T02:28:18.355437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 1
2025-10-15T02:28:18.355440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 2
2025-10-15T02:28:18.355444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 3
E1015 02:28:18.356593048 3839189 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:27659: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-15T02:28:18.359452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 53 partNo 3 result is x0000000000_00000000000000000049_00000_0000000003_00015? size 8295638
2025-10-15T02:28:18.359472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 4
2025-10-15T02:28:18.359487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000049_00000_0000000003_00015? new key d0000000000_00000000000000000049_00000_0000000003_00015? size 8295638 WTime 1760495298355
2025-10-15T02:28:18.359610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 4 FormedBlobsCount 1 NewHead: Offset 52 PartNo 3 PackedSize 717145 count 1 nextOffset 53 batches 2
2025-10-15T02:28:18.359629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-10-15T02:28:18.359635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 1
2025-10-15T02:28:18.359639Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 2
2025-10-15T02:28:18.359643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 3
2025-10-15T02:28:18.359646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 4
2025-10-15T02:28:18.360536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 4 FormedBlobsCount 0 NewHead: Offset 52 PartNo 3 PackedSize 2970343 count 2 nextOffset 54 batches 6
2025-10-15T02:28:18.360558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-10-15T02:28:18.360565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 1
2025-10-15T02:28:18.360569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 2
2025-10-15T02:28:18.360573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 3
2025-10-15T02:28:18.360576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 4
2025-10-15T02:28:18.361099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 4 FormedBlobsCount 0 NewHead: Offset 52 PartNo 3 PackedSize 5223541 count 3 nextOffset 55 batches 10
2025-10-15T02:28:18.361122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-10-15T02:28:18.361130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 1
2025-10-15T02:28:18.361132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 2
2025-10-15T02:28:18.361136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 3
2025-10-15T02:28:18.361139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 4
2025-10-15T02:28:18.362355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 4 FormedBlobsCount 0 NewHead: Offset 52 PartNo 3 PackedSize 7476739 count 4 nextOffset 56 batches 14
2025-10-15T02:28:18.362383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-10-15T02:28:18.362388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 1
2025-10-15T02:28:18.365007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 57 partNo 1 result is x0000000000_00000000000000000052_00003_0000000004_00014? size 7988760
2025-10-15T02:28:18.365031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 2
2025-10-15T02:28:18.365040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 3
2025-10-15T02:28:18.365044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 4
2025-10-15T02:28:18.365056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000052_00003_0000000004_00014? new key d0000000000_00000000000000000052_00003_0000000004_00014? size 7988760 WTime 1760495298364
2025-10-15T02:28:18.365366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 4 FormedBlobsCount 1 NewHead: Offset 56 PartNo 1 PackedSize 1741199 count 1 nextOffset 57 batches 4
2025-10-15T02:28:18.365380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-10-15T02:28:18.365388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 1
2025-10-15T02:28:18.365391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 2
2025-10-15T02:28:18.365394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 3
2025-10-15T02:28:18.365398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 4
2025-10-15T02:28:18.366467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 4 FormedBlobsCount 0 NewHead: Offset 56 PartNo 1 PackedSize 3994397 count 2 nextOffset 58 batches 8
2025-10-15T02:28:18.366490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-10-15T02:28:18.366495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 1
2025-10-15T02:28:18.366499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 2
2025-10-15T02:28:18.366502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 3
2025-10-15T02:28:18.366506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 4
2025-10-15T02:28:18.367608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 4 FormedBlobsCount 0 NewHead: Offset 56 PartNo 1 PackedSize 6247595 count 3 nextOffset 59 batches 12
2025-10-15T02:28:18.367632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2359: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-15T02:28:18.367754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 56,3 HeadOffset 49 endOffset 49 curOffset 59 d0000000000_00000000000000000056_00001_0000000003_00011? size 6247585 WTime 1760495298367
2025-10-15T02:28:18.368633Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-15T02:28:18.368652Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 49 partNo 0 count 3 size 8295638
2025-10-15T02:28:18.368660Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 52 partNo 3 count 4 size 7988760
2025-10-15T02:28:18.368668Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 56 partNo 1 count 3 size 6247585
2025-10-15T02:28:18.381121Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-15T02:28:18.381147Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-15T02:28:18.385080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 4 of 4 from KV. Status 1
2025-10-15T02:28:18.385097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-15T02:28:18.385100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-15T02:28:18.385101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-15T02:28:18.385103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 3 from KV. Status 0
2025-10-15T02:28:18.385114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 39 count 1 size 1741189 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:18.385118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 40 count 1 size 2253220 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:18.385125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 41 count 3 size 8295638 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:18.385130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 44 count 2 size 2970333 actorID [2:7561269726540086361:2474]
2025-10-15T02:28:18.385190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 39 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-10-15T02:28:18.385199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 40 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-10-15T02:28:18.385203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 41 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-15T02:28:18.385206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 44 partno 3 count 2 parts 5 suffix '63' size 2970333
VERIFY failed (2025-10-15T02:28:18.385494Z): Something went wrong
  ydb/core/persqueue/pqtablet/partition/partition_compaction.cpp:447
  BlobsForCompactionWereRead(): requirement false failed
2025-10-15T02:28:18.385302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:381: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-15T02:28:18.385313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:442: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-15T02:28:18.385468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:60: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-15T02:28:18.385482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:446: [72075186224037892][Partition][0][StateIdle] Can't append blob for key d0000000000_00000000000000000039_00001_0000000001_00003?
NPrivate::InternalPanicImpl(int, char const*, char const*, int, int, int, TBasicStringBuf<char, std::__y1::char_traits<char>>, char const*, unsigned long)+423 (0x14A3B997)
NPrivate::Panic(NPrivate::TStaticBuf const&, int, char const*, char const*, char const*, ...)+263 (0x14A32247)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+7690 (0x245B756A)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+5681 (0x24462581)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15648778)
NActors::TExecutorThread::Execute(NActors::TMailbox*, bool)+3317 (0x1568C135)
??+0 (0x15690243)
NActors::TExecutorThread::ProcessExecutorPool()+657 (0x1568FE51)
NActors::TExecutorThread::ThreadProc()+191 (0x15690A3F)
??+0 (0x14A3D7FD)
??+0 (0x7F43C002BAC3)
??+0 (0x7F43C00BD8C0)
